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Chapter I - Introduction 



Many curriculum reforms have in the history of our schools been 
acconq^nied by confusion about just ‘tdiat they were supposed to acccnnplish 
and by ignorance about the feasibility of trying to accomplish whatever it 
was ttiey were doing at the level at which they were trying to do it. 

In instituting the Critical Blinking Readiness Project it was our hope 
to do what ve could to help avoid these two dangers in the attenqpts to 
introduce instruction in critical thinking. Our primary goals in this 
project are to contribute to knowledge about what critical thinking is and 

i 

/ 

to knowledge about when it can be taught. This report, covering the first 
phase in our atten^its to achieve these goals, deals with deductive logic - ' 
and adolescents (age 10-18). 

A more specific list of the purposes of this phase follows. Some of 
these purposes are subsidiary and scnne are con^lementary to the above - 
me’ tioned pair of goals, as limited for this first phase . 

1. To became more clear about the nature of deductive logic, as 

used in ordinary reasoning and to conqpare this analysis with Piaget's 
to see ^elher we were talking about the same thing. 

2. To find out when students are rea^ to master principles of deductive 
logic .. 

3. To be clear about the concept, readiness to master a principle . 

4. To build logic tests suitable for use in this study. 

5. To provide an operational interpretaticii of ^mastery of a principle'. 

6. To investigate the degree of mastery of principles of logic 
currently found among students of ages IO-I8. 

In this report there are no definitive answers to the questions iiq>lied 
by those purposes, but two general principles have clearly emerged as a 
result of our efforts: 

1. In this area of study there are many conceptual pitfalls for the 
unwary . 
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2- Ansvers to the ouestioDB Implied by the above list of mgposes 
are of the 'that depends* form . For exan^le^ the ansvar xo the 
question about when students are ready to learn deductive logic 
depends not only upon the type of logic, but also upon the 
principle of logic within that type. In his developmental 
studies of knowledge of logic, Piaget distinguished only among 
types of logic, making rather broad statements about these types. 

This report of our efforts to achieve these purposes is divided into 



eight chapters. Each chapter is fairly self-contained, but is best under- 
stood in conjunction with the others. Rrobably the best order of reading 
is to start with this, the introductory chapter; then to read the last, the 
summary chapter; and then to read the other chapters in order (Chapters 
II to VII ). The middle chapters, \diich make up the body of the report, 
are in a plausible seq;uential order. Here is a list of the q[uestions dealt 
with in Chapters II throu^ VII, and a list of the corresponding chapter 
headings: 



Questions 



Chapter Headings 



I. What is to be found in the report? 



IHTROIlOCnON 



II. What is the nature of the logic content 
we were trying to convey and how does 
this compare with Piaget's notion of logic? 

III. Who were our subjects and how did we secure 
information about 'ttiem? 



THE SUBJECT MATTER: 
LOGIC 

BASIC DATA ON SUBJECTS 



IV. What is the nature of the tests used to THE CORNELL BEDDCTIOH 

measure knowledge of logJ.c, and how did TESTS 

we operationally interpret 'mastery of a 
principle of logic*? 



What sort of development of knowledge of THE NATURAL-CULEIIQRAL 

}.oglc occurs without deliberate instruction BeVELOPNERT OP 
in school, that Is, as a result of what we KN0WXED6E OF LOGIC 
have called "natural-cultural influences”? 

How does this development vary for different 
principles of logic, and how does it vary 
with the content of the propositions used in 
reasonii^? 
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Questions 



VI. Vfhat principles of logic vere our subjects 
ready to master, given 15 dally periods of 
instruction in logic? And vhat sorts of 
content were they ready to reason with? 
What are other students ready to master, 
given con?)arable instruction? What is the 
meaning of 'readiness for mastery of a 
principle ' ? 

VII. What happened in prior years that led up 
to the work directly reported on here. 

What is next? 



Chapter Headinyiy 
THE DEVELOPMENT OF 

readiness to 

MASTER LOGIC 



THE PAST AND PUTURE 
PLANS OP THE PROJECT. 



VIII. Briefly ^at appears in this report? SUMMARY 



In organizing this r^)ort we considered having a chapter on the 
statement of the problem, one on related research, one on procedures, one 
on analysis of data, etc., but decided against this approach because it would 
fragment the focuses of concern. Instead each chapter contains, if appropriate, 
a section clarifying the problem, a section on related literature, a section 
analyzing key concepts, etc. Diis we believe gives the report greater unity 
than it otherwise would have and makes for less page turning on the part of 
the careful reader. 

In much of the work reported on here, we were exploring virgin territory, 
and found that we were spending a good deal of time on questions prior to 
the actual standard ejqperimental activities of doing and observing. These prior 
questions involved clarification of questions and concepts and their 
operational interpretation (including test construction). Although our 
empirical findings are important, peiiiaps the. greater contribution of 
this study lies in the suggestion of ways of approaching the readiness 
question, and in the clarification of concepts basic to the empirical work. 
Actually this study only opens the door to a vast 




array of investigations. 



Chapter II, She Subject ^tter: Logic ■ 

■' o 

In thla chapter ve shall first examine the nature of our general concern, 
critical thinking, indicating the role played by deductive logic; then we shall 
examine" deductive logic itself, discussing the nature and iagportance of various 
types, and comparing the logic we taught with that which Piaget investigated. 
Birouj^out we shall attempt to avoid decisions that commit us to a stand on some 
of the contemporary issues in the field of logic. Although we do have opinions 
about many of these issues, the actual criteria that we use (especially our test 
items) should be acceptable to the major contending positions in conten^rary 
logical theory. 

A. AN ANALYSIS OF CKETICAL THIBKIHG 

Our analysis of critical thinking springs from the basic notion put forward 
by B. Othanel Smith: "Now if we set about to find out What...^a 7 statement means 

and to determine Whether to accept or reject it, we would be engaged in thinking 
TdiiCh, for lack of a better term, we diall call critical thinking." (1953, p. 130) 
Note that this notion of Smith »s inplies a distinction between critical and 

creative Ihinking. In critical thinking, the item to be evaluated has already 
been produced. 

Ihis distinction between critical and creative thinking enables one to divide 
in two parts the problem of teaching people to be good thinkers. Each part is of 
course gpite important and in practice the parts are quite interdependent. But 
Ibr purposes of careful investigation, it is helpful to separate out this part 

(critical thinking), for the Judgment of which there are already fairly well 
established criteria. 

A minor difference between our notion of critical thinking and that which 
anith presents can be found in the fact that we have included the idea of pro- 
ficiency in ours, ihereas anith does not reqjulre that the determination about 
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lAiether to accept or reject be done properly or well in order that critical 
thinking take place. We believe that our notion ia more in accord Tilth everyday 
uaage^ but feel that ao long as one is clear about vhich notion he ia using and 
makes sure that the rest of the theory fits “ttie notion selected^ either notion 
is Tiorkable. 

Accepting this basic notion as revised, the principal investigator has been 
develcqping and refining a list of abilities Tihich characterize the critical 
thinker. The folloi^Lng list represents the current state of this investigation. 
Although it is fairly self-e:qplanatory, one might Tiant to seek clarification in 
the selection, "A Definition of Critical Thinking" (Binis, 196I*a), or in the more 
theoretical analysis, "A Concept of Critical Thinking” (Ennis, I962). 

A critical thinker is characterized by proficiency in judging ihether: 

1. A statement foUovs from the premises. 

2. Something is an assuoq^ion. 

3. An observation statement is reliable. 

if. A simple generalization is varranted. 

A hypothesis is Tiarranted. 

6. A theozy is warranted. 

7* An argument depends on an anhiguity. 

8. A statement is overvague or overspecific. 

9* An alleged authority is reliable. 

Although the basic notion, as revised, calls for the incliision of proficiency 
in judging value statements, for the time being that proficiency is excluded from 
our list because value statements constitute one area where fairly well estab- 
lished and agreed i;qpon criteria do not exist. 

Deductive logic, the subject of the current study, is a central part of 
critical thinking, as analyzed above. First of all, since it deals with the 
qpestion of ihether a statesmnt follows necessarily frem another statement or 
statements, it is at least central to the first of the dine aspects listed above. 



Bowmr^ thougjh opinionB may differ on this matter^ deductive logic does 
not aeem to ua to e^diauat this aapect of critical tbinking. Altfao«^ logic la 
a guide, tlie validity of moat real arguments appears to us to depend on other 
consideraticms* !Ehe connection between the premises and conclusion does not 
eeem as strict as that in the laodel provided by deductive logic. Hie correct- 
nees of this claim about the relation between premises and conclusions and the 
nature of the relationship that does exist ore laportant topics for philosophl- 

research. But regardless of the outcome of this researd:\ it must still be 
granted that deductive logic plays at least a major role in tht first aspect 
of critical thinking. 

Secondly deductive logic ploys an important role in the other aspects as 
veil. Among other things, it is a constituent of the a^Q^icatlc^ of the cri* 
teria and/or principles of the other eight aspects. 

Frlmarlly because of its centrality in critical thinking, but also because 
its criteria seemed to be in more suitab/e shape than the criteria for other 
aspects of critical thinking, we picked deductive logic as the first thing to 

be investigated. It is our hope to perform and/or to stimulate parallel !»n d 

% 

complementary investigations of other aspects of critical thinking. 

B. TYPES OF IffiDOCnVE LOdC 

For purposes of this study the following explanation of the meaning of 
'deductive logic* will suffice; Deductive logic is concerned with whether a 
statement follows necessarily from one or more other statesients. A statem^ 

follows necessarily, if, and only If, its denial contradicts the assertion of 
the other statenent(e). 

Hirec recognised types of deductive logic arc sentence logic, class logic, 
and ordinal logic. Hiese types are often called by other names, the name de- 
pending sometimes on one's phlloscphy of logic, but these names will serve to 
identify Ihree types of logic which axe often so grouped. 
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1. Sentence Logic . 

Sentence logic is concerned with Rpgunents in \diich the basic units are 
sentences* That is^ distinct sentences^ often connected or modified by such 
logical connectives as 'if*, 'only if, 'then', 'and', 'or', 'not', and 'both*, 
appear essentially unchanged throughout the course of the argument. Here is an 
example taken from "The Cornell Conditional Reasoning Test"; 

Suppose you knov that 

Tom may use paints only if he has cleaned up his clay work* 




Tom may use paints* 

Then vould this be true? 

Tom has cleaned up his clay uork* 

In that series ttie tvo sentences, "Tom may use paints" and "Ttan (or he) has 
cleaned up his clay vork", each appear twice. In the first of the two given 
statements they are Joined by the logical connective, "only if", but these two 
basic sentences appear essentially undhanged throughout the course of the argu- 
ment* Hence this is a case of concern for sentence logic. 

Sometimes sentence logic itself is broken up into parts, depending on the 
logical connective which is used* Wien the connective is *if, 'only if, or 
'if, and only if, dr any synonyms of these, we have what is soaietimes called, 
and that we shall call, a 'conditional statement'. Arguments which contain only 
conditional statements and simple sentences or negations thereof shall be called 
conditional arguments* Reasoning associated with such arguments shall be called 
conditicmal reasoning. 

Other ^fpes of sentence logic are called different systesis of names* One 
consistent set labels as 'alternation statements' those which make use of the con- 
nective, 'or*; 'disjunctive statements' those which use the connective 'not***both' 







and ’conjunctive statementa* those vhich contain the conjunction ’and* (Cohen 

and Itegeli 193^} • A more common se.t of labels at tiie present tine implies ^e 
word 'disjunction* to statements containing ’or’ instead of those 
’not*** both’^ and considers the latter sinpl/ denials of conjunctions* Al«> 
though we did not have to make a choice for the present research project^ a 
choice will have to be made in the continuation into these areas* She choice 
is not siisply an arbitrary one^ since it depends to sons extent on one’s philoso- 
phy of logic* Our current inclination is to recomnend the former system to 
^'eople investigating these areas in the future^ because the ccsmection Implicit 
in a 'not**. both’ statement appears to be more fully recognized with the sepa- 
rate name ’disjunction’^ and because the names of the former system sera more 
natural* 

2* Class logic * 

Bie familiar traditional syllogisms are arguments in class logic fbrm^ but 
they do not e^diaust class logic arguments, so a more general description is 
necessary. 

Bie basic units in class logic are parts of sentences, subjects and 
predicates* !Ehe sentences do not reappear essentially unchanged; the 

sihjects and predicates are separated traa each other and rearranged* Here is 
an ex a nq ^e to ihiCh the criteria of class logic are to be applied. It is from 
*^e Cornell Class-Reasoning Test”: 

Suppose you know that 

All the people who live on Msin Street were bom in MLlltown. 

Rone of the students in Boom 352 live on Main Street* 

Ihen would this be true? 

Rone of the students in Boom 352 were bom in Milltovn. 

For purposes of simplification and ease of teaching, the subject and predicate 
^ order to form classes* FoUowiag Uiis procedure tte classes in- 
volved in the Cbove exasple are l) the people who live on Main Street, 2) the 
people iho were bom in NiUtown, and 3) the students in Boom 352. 9ie two 
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given statements present reiatlcnships between the first and second classes and 
the third and second classes respectively. !Ehe statement about which one must 
decide suggests a relation^ip between the third and first classes. Ihus the 
siH)Jects and predicates as represented by the classes are the basic units in 
this kind of reasoning. 

Admittedly the representation of subjects and predicates by classes is a 
simplification which can result in philosophical problems. However^ as long as 
one is cautious enougji to avoid thinking that the class relationships somehow 
more suitably capture the meaning than the original statements^ the transfor- 
mations can be convenient in explanation and teaching. 

3* Ordinal Logic . 

A third type of logic deals with size relationi^ips^ such as^ greater than^ 
equal to, less than, not greater than, etc. Here is an example taken from Burt*s 
"(hraded Reasoning Tests" (1919): 

Tom runs faster than Jim; Jack runs slower than Jim. Who is the 
slowest — Jim, Jack, or Tom? 

k. Other Types of Logic . 

Ho successful conprehensive classification system of types of logic has 
even been prepared, so the best we can do here is to list some other types with 
an explicit disavowal of comprehensiveness. 

Mathematical reasoning is such that the conclusion is supposed to follow 
necessarily from the premises and would therefore be classified as logic. Since 
we have no desire to enter the Jurisdictional dispute (about which is a brandi 
of Which) between some logicians and some mathematicians, we sisply point out 
the consequences of our definition, being ready to accept an amendment, if 
desired. Our definition, however, should at least serve to alert us to the 
similarities between the fields of mathematics and logic. 




Several other branches of logic with which at least some work has been 
done by logicians are, xising the terminology suggested by 0. H. von 
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(19^^ P* alel^ic logic (traditionally called 'modal logic *)^ epistemlc 
logici and deontic logic. Alethic logic is concerned with statements of pos- 
sibility and necessity; epistemic logic with knowledge statements; and deontic 
logic with statements of obligation. Each of these branches of logic is impor- 
tant in critical thinking^ but no one of them has yet been sufficiently worked 
out for us to do research on them of the sort uhich is being described in this 
report. Hopefully the current trend among philosophers toward Increased in- 
terest in these fields will continue^ so that some satisfactoxy criteria will 
be available for use in research like ours. 

Presumably other types of logic could yet be identified^ because no one 
has successfully presented a rationale for the esdiaustlveness of some list, 
and it has been our e:q>erience that numerous exaiig>les of inferences that seem 
in a way necessary do not clearly and uncontroverslally fit any of the types 
mentioned. Applications of broad value statements and Inferences to and tnm 
statements containing su^ words an 'probably' and 'because' are the sorts of 
thing we have in mind. 

there is thus still much philosophical spadework to be done, both in 
identifying types of logic and in determining valid patterns of inference for 
the relatively unexplored types. Iftitil this philosophical spadework is done, 
the investigation of patterns of development, learning, and learning cq^city 
in the types of logic must remain unfinished. 

C. AN ELABOBATION OF TEE TCPES OF lOOIC INVE8T1GA1ED IN THIS STUOr 
thouj^ an investigation of all types of logic is not yet possible, we were 
able to work with two very comaon and significant *^pes of logic, class logic 
and conditional logic. We picked these for several reasons: 

1. The criteria for Judging arguments in these forms of logic are fSirly 
well developed and agreed igion. Where controversy does exist,* we essentisdJy 
avoided it. 




*See7rTrSKw5o5a*s Intrototion to Logical Theory (1952) for an indication of 
areas of controversy ^at do exisT. 



2. Ohese tvo types of logic > 1x>gether >ilth the other kinds of sentence 
logic, are the things most commonly tau^t under the heading, "deductive logic”, 
are thus veil associated with the tens, 'deductive logic'. We felt that ve were 
forced to select from among the branches of sentence logic because of time 
pressures, and picked conditional logic because the if-then relationship is 
fundamental in all logic and because an understanding of conditionals together 
with conjunction and negation enables one to do other types of sentence reasoning. 
!Diis selection of conditional logic from sentence logic should be kept in mind as 
you read the next two reasons for our selection of certain types of logic, because 
they argue for the inclusion of sentence logic instead of only conditional logic. 

3« An informal investigation that we performed of reasoning in newspaper 
editorials, U. S. Supreme Court opinions, and an auto mechanics handbook shoved 
that class logic and sentence logic included most of the deductive reasoning that 
occurred there. Ihe only notable exception was deontic logic, the logic of 
obligation. 

In the literature on people's reasoning there is some precedent for 
the selection of class logic and sentence logic. Most of the st\idies that we 
have located deal with one or both of these types. 

5» Althou^ ordinal logic is well worked out, is already being taugjit in 
schools, and is considered in the literature, ve omitted it. We did include it 
in our pilot study, but felt that in order to do a more satisfactory Job in the 
year 1963-6^* we had to reduce the scope of our project from three *types of logic 
to two. BarUy because ordinal logic is inevitably receiving some readiness 
attention now; partly because our pilot study showed that major advances in 
capaci'ty for mastery of the principles of ordinal logic occurred in the primary 
grades (ages 6-12), especially early primary (ages 6-9) for most of the students 
we studied; and lastly because work of the were dpi p g reqiuires more 

personnel for younger children, we decided to omit ordinal logic in the study 
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being reported on here.* 

Given clasB and conditional logic as our concerns, a fuller account of each 
is in order. In ;4iat follows we shall set forth and discuss what we consider to 
be the basic principles of each. These lists of principles are not in the most 
elegant form (for the more elegant they are, the less easy they are for most 
people to understand), nor are they in the most easily understandable form, but 
are in a form that is something of a con5)romise between the two. 

In our teaching of logic we did not use the language of these statements of 
principles, because we felt much of it to be too formidable for teaching purposes. 
Ihis is so especially for class logic, in the teaching of idiich we made use of a 
system of circles Which provided a model for class relationships. 

With but one exception the principles are tested for in our tests, which will 
be described later. This exception. Conditional was fitted for reasons 
given in Chapter IV, which describes the tests. Some combinations of these prin- 
ciples are also tested for in our tests. These combinations are not listed here. 
They will be indicated in Chapter IV. 

In the hope that they will be self-explanatory, these lists are arranged 
as follows: On the left the principle is stated in Etaglish. In the center and on 
the right arguments appear. In each case the principle Justifies a Judgment of 
valid (conclusion follows necessarily) or invalid (conclusion does not follow 
necessarily) with respect to the argument. The argument in the center is in 
symbolic form. The argument on the right is an example taken from one of our 
tests and modified for the purposes of this method of presentation. 

The conditional logic principles are ordered in our recommended order of 
classroom presentation. This ordering is based upon our es^erience teaching 
logic, but has not been subjected to experimental test. 

* Professor lAicille RLngel of Fenn College, Cleveland, is preparing a report of 
the work that we did do with ordinal reasoning. 




’She validity status of the arguments will only be specified for the symbolized ones. 
It is the same in each case for both the synibolized and concrete arguments. 
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On the o'Qier hand the principles of class logic are not strictly in a recom- 
mended teaching order, since o\ir teaching method for class logic makes use of 
the circle system mentioned earlier. But ve think that the first four of these 
principles are grouped rou^ily in teaching order anyway. 

A fev words of sunaary of these principles are in order. The conditional 
principles cover affixing and denying the antecedent ("if -part" and "major part") 
and consequent ("then-part" and "only-if-part") in both if-then form (1-4) and 
only-if form (8,9,U>12). Transitivity ( 5 ), contraposition ( 6 ), non-symmetry ( 7 ), 
and the cooibinatlon of If-then' and bnly if*(lO) are the o'ttier things covered by 
the conditional logic principles. A person familiar with conditional logic will 
recognize these as the basic elements of conditional logic^ though he might of 
course feel some redundance if he seeks logical elegance. It is our view that in 
spite of this sort of redundance^ the principles must at least for teadilng pur- 
poses be spelled out to the extent that we have done so. And then there is the 
very difficult giuestlon of idiether they really are redundant anyway^ because tlie 
different forms (as ve have specified -ttiem) are used under different circumstances. 
Fortunately ve do not have to settle the question because teaching requirements 
force the large number of principles on us. 

The class principles cover first of all the basic meaning of being and not 
being a mssher of a class (l)^ and secondly the basic notion of two classes' being 
excluded from one another (4). Then the main body of principles falls into two 
groiqps: those starting with the assumption that something is in* a class (or 
part of a class) ^ ( 2 > 3 ^ 8 ) and those starting with the assumption ‘ttiat something 
is not in a class (or part of a class)^ (5#6^7). Each group is then subdivided 
into three parts according to whether that class (or part of a class) is • a) 
included in a third ( 2 ^ 6 )^ b) includes a third ( 3 ^^) or c) is excluded from a 
third (8^7)* Thus the possibilities are all covered. 




* Deliberately vague to cover both menbership and inclusion. 
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We regard class principles numbered 2 and 3 as the tm most iiqportant to 
teach to someone if he does not know them* Nuniber 2 catches the transitlvily 
of inclusion idiile number 3 catches its non-symmetzy. 

A good vay to grasp the impact of the class principles^ if the argunents 
do not suffice as explanation^ is to use circles inside one another or separate 

dT 

from one another to represent the inclusion fr exclusion relationships.* A 
conclusion inescapably diagrammed by the diagramming of the premises follows nec- 
essarily. If not inescapably diagrammed^ then it does not follow necessarily. 

Ihat completes our direct characterization of the logic 'Qiat we tauc^t* 

Ihe next section^ idiich compares this logic witii Piaget's^ indirectly provides 
seme further characterization. 

D. A COMPABISON WI!EH HACaST'S LOGIC 

Jean Piaget is the leading figure in the study of the development of 
children's knowledge of logic ^ though not their capacity to learn logic ^ idiidi 
was in addition one of our major concerns. Since a comparison with his con- 
clusions is inevitably called for, it is important to try to be clear about 
whether what Piaget calls 'class logic' and 'propositional logic' correspond 
to idiat we have called 'class logic' and 'sentence logic', because only to 
the extent that they correspond does the question of agreement or disagreement 
about the facts of development arise. In some ways the logics seem to corre- 
spond and in some ways they do not seem to do so. In fact it is difficult 
to be sure of the extent of correspondence. !Ihis mi^t be explainable by 
Piaget's difficult style; and it mi^t be explainable by changes over time 
in his concepts to adjust to the facts or his own developing interests* Re- 
gardless of the explanation, the points of correspondence and lack of corre- 
^ndence, as we see them, follow. We must confess that we have not been able 
to construct with confidence what we consider to be a coherent consistent 
account of Piaget's logic, but we ^all do the best we can. Discussions of 

^ *lhi8 is a simplified account, as you ml^t exqpect. 

ERIC 
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Piaget's logic have also heen presented by Parsons (i 960 ) and ELavell ( 1963 ). 
Points of Correspondence . 

First of all Piaget did talk about logic. Secondly he does distingidsh 
betveen tvo types of logic^ and thirdly this distinction basically seems to 
correspond to the distinction betveen class logic and sentence logic that ve 
drew earlier in the chsqpter. We shall expand on each of these points. 

1. Piaget seems to have adopted some of the basic moves and definitions in 
contemporary propositional logic (1958*^ PP* 293-303) • His logical operators, 

'V, 'y', and correspond to the operators of traditional propositional 
logic, and stand respectively for 'or', 'if..., then', 'and', and 'not'. He 
makes use of the same letters as are traditionally used to represent propositions, 
'pS 813d 'r'. And he generally relates all these in a vay that essentially 
conforms to that of any elementary text in symbolic logic. 

Flirthermore his class logic synibolism, definitions, and rules are in con- 
formity with at least much of vhat is traditionally classified as class logic. 
Among other things, he uses capital letters to represent classes and uses a 
single quote after a letter Which represents a class to represent the complement 
of that class ( 1938 , pp. 27 ^ 77 )* 

Hence it is qiulte clear that Piaget vas talking about logic, establishing 
at least some correspondence betveen his interests and ours. 

2. Along with us, Piaget resists the contemporary trend toward the merging 
of propositional and class logic. This merging is accomplished by treating class 
inclusion statements as modified conditionals. Fbr exan^e, the statement, 'All 
floating bodies are light', is transformed into the statement, 'Fbr every x, if 

X is a floating body, then x is li^t'. 

* Henceforth in this section on Piaget, all references made by the use of '1938' 
idiall be to Inhelder and Piaget's The Growth of Logical ThinklDg F^om Childhood 
to Adolescence . We believe toat the parts to ^Ich ve refer were vrittmi by 
Piaget and not Inhelder. 
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Sometiffles the transfoxnation goes further, putting the stateaent in terns 
of existence, conjunction, and negation, making the above statement look like 
this: 'It is not the case that there exists an x such that x is a floating body 
and X is not lig^t. ' 

One of Piaget's reasons, vith i^ich ve are in syaqpathy, is that to so 
interpret class inclusion statements vould be to use "a complex language for 
describing phenomena vhich do not go beyond much simpler structures in the 
subject's mind" (19^, p. 280). 

3* A third point of correspondence lies in the similarity of his basis for 
the distinction between propositional and class logic and our basis for the dis- 
tinction between sentence and class logic* Piaget says that al1iiou£^ class logic 
does deal with propositions, "decomposing and recomposing the content of proposi- 
tions" (l9^i P* 292), it does not deal with the conibinaticna of liiese proposi- 
tions as independent units. Propositional logic, on the other hand, does this. 

In another place Piaget in diaracterizing the formal operational period 
by a person's ability to do propositional logic, says, "Formal operations, 
therefore, consist essentially of 'inplications' ... and 'contradictions' 
established between propositions idiich themselves express classifications, 
seriations, etc." (1950, p. 149). 

Thus for Piaget, as for us, class logic is concerned with the internal 
features of propositions idiich are wt themselves composed of other proposi- 
tions, idiereas propositional (and sentence) logic is concerned wl*Ui the rela- 
tions between propositions (or sentences) which themselves remain essentially 
unchanged throu^out an argument* 

^ do not feel that the difference in names ('propositional* vs* 'sentence') 
constitutes a significant difference between Pisget and us. Bis term, 'pxoposl- 
tional' is in more common use among logicians; for that reason we would have 
chosen it if we had not felt that coenunication with teachers and students will be 

o 
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facilitated ly the use of the tena ' sentence ^ idiich already has meaning for them. 
Ihe tem 'proposition* in the sense in ^ich it is used by logicians is quite 
unfamiliar to most people. 

Rb¥ it is the case that the tvo terms can be used to mark different positions 
in philosophy of logic^ but the use of one term or the other does not necessarily 
coamit one to one of the positions, since the choice of one term or the other is 
often simply a matter of convention or convenience. Ihe positions that can be 
marked by these terms are positions about the nature of the basic units that are 
connected and modified by the logical connectives, 'or', 'if..., then', 'and', 
'not', etc. Are the basic units merely strings of words concocted by human 
beings, or are they possessed of some sort of independent existence, regardless 
of vhether they are fbxmulated by h^onan beings? 

We do not want to take a stand on this issue; ve do not even want to take 
a stand on whether or not it is a genuine iss\ie. But ve do want to use the 
term 'sentence' because of its established usage. Ve do not knov vhether Piaget 
takes a stand on the issue, but feel that as far as the teaching of the rules of 
logic goes. It does not matter. His difference in usage does not represent a 
substantive difference. 

Points of Boncorrespondence . 

There are two points of noncorrespondence vhich ve vould like to suggest: 
First the Judgment about idiether propositional or class logic is in use seems at 
times to depend for him upon vhether there is a consideration of all the possi- 
bilities liflxerent in the situation. Secondly Piaget's system is more sisple than 
the one ve worked vith. We are less sure about the first difference than the 
second. 




1. According to Piaget (1958, pp. 272-333) an important feature of a 
person's reasoning is the extent to vhich he works vithin a system of all the 
possible coti)inatlons of the variables and vievs vhat he sees as one of these 
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possible combinations. Associated with this^ according to Piaget^ is the subject's 
ability to separate out the variables. Presumably if a person separates out 
variables and holds certain ones constant^ then he is eliminating certain of 

the possible conbinations of variables as possible causes of the phenomena being 

* 

investigated. 

fhere is a strong suggestion that a defining characteristic of ability at 

propositional logic is ability to vork within a system of all possible combinations. 

Furthermore a defining characteristic of the use of class logic is the failure to 

work within a system of all possible combinations. Siese are not defining 

characteristics of our sentence and class logics. 

He Bays, in searching for a way of telling "in which cases the subjects 

reasoned through arrangements of classes and relations and in i^ich cases they 

used propositional operations" (1958^ p. 279) i "It is fruitless to look for an 

exclusively verbal or linguistic criterion — e.g.i considering all statements 

containing the words 'if... then* as implications while regarding the statements 

i4iich do not contain them as inclusions or correspondences, etc." (1958, p. 279)* 

He then says that a better method of making the Judgment about idiether class or 

propositional logic is in use is look at all the actions of a subject and see: 

idiether he tries to separate out the variables, isplies both 

hypothetico-deductive reasoning and a combinatorial system; when they 
appear, we have to Interpret the stated Judgments as propositional ex- 
pressions ... (1958, p. 279)* 

Ohus separating out the variables seems to be a criterion of the use of proposi- 
tional logic. 

But the "surest method of differentiation", according to Piaget is to see if 
the 8\d>Ject intexprets a given correspondence as the result of any one of several 
possible conbinations: 

If.. .the subject intexprets a given coxrespondence as the result of 
any one of several possible coablnatlons, and this leads him to verify 
his hypotheses by observing their conseqiuences, we know that propositional 
operations are involved (19^, p. 279). 

o 
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It is becaiise of these statements and statements like them that ve suspect 
that Piaget holds that a definitionally necessary condition for the use of 
propositional logic is that of working within a system which contains all the 
possible coidbinations of the variables^ and that a definitionally necessary 
condition for the use of class logic is the lack of working within such a system. 

What it is to work within such a system still remains to be clarified and un- 
fortunately Piaget dees not make himself fully clear. Here is the best account 
that we can work out: 

According to Piaget^ given two propositions (or classes there are sixteen 
possible ways in which they can be groiqped. For propositions he calls these ways 
the "sixteen binary operations" (1958> P* 293) and for classes he simply lists 
them as "sixteen possible coniblnations" (19^> P* 277)* Ihe two lists carrespond^ 
as he indicates in a series of footnotes in his discxisslon of the sixteen binary 
operations (1958> PP* 293-303)# so we will present only the list of the sixteen 
binary operations. 



In this list 'p' and 'q* stand for propositions. A denial of the proposition 
is represented by the sysibol with a line over It^ e.g.^ ’p'. A conjunction of two 
propositions is shown by putting a dot between them e.g.^ *P*Q.' vhlch means 
*p and q'. 'Either p or q' is represented by 'p v q', and 'If p, then q* is 
represented by 'p 3 q' . 

Ihe sixteen binary operations: 

1. p.q V p.q V p.q v p.q 

2. Ihe negation of #1. 

3« P«q 

4 . Ihe negation of #3: p.q 

5. p V q 

6. Ihe negation of p.q 
7* P^q 

8. Ihe negation of #7: P*q 

9. q^p 

10. Ihe negation of #9: p.q 

11. (pDq).(q^p) __ _ 

12. Ihe negation of #11: p.q v p.q 
1^. p.(q V 5) 



o 
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Ihe negation of #L3: p.(q v q) 
15. q.(pvp) 
lo. Ihe negation of #15: q.(p v p) 
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A person acqiialnted with synibollc logic can see that (given the symbolic logic 
interpretation of these symbols) this list contains the affirmation and denial 
of each of the possible groupings of p and q and their denials, for him uho is 
not veil acquainted with symbolic logic the e:dhaustlveness of the combinations 
that Piaget sees perhaps can be shown thuslys 
Let *a' stand for *p.q* 

Let 'b' stand for *p.q' 

Let 'c' stand for 'p.q* 

Let *d' stand for *p.q' 

These are the four x>08Sible conjunctions of the assertion and denial of 'p* and 
'q*. Ihen there are sixteen possible ways that *a’, 'b*, *c', and 'd* can be 
grouped: 



1. 


a 


2. 


b 


3* 


c 


4. 


d 


5. 


ab 


6. 


ac 


7. 


ad 


8. 


be 


9. 


bd 


10. 


cd 


11. 


abc 


12. 


abd 


13. 


acd 


14. 


bed 


15. 


abed 


16. 


0 (that is, none of them)* 



If one accepts the assumptions^ one can see the esdiaustiveness of the system of 
cooiblDatlons of the assertion and denial of the two propositions. 

Row we suspect that for Piaget a person is not doing propositional logic 
unless he it operating within a framework that will take account of all of these 
possibilities. If this suspicion is correct^ then Piaget's logic does not corre- 
spond to the logic that we taught^ nor does it correspond to the standard con- 
tenporaxy interpretation. The latter mijjxt say that a person is not fully pro- 
ficient if he does not operate within such a ftranework^ but it would not deny the 



o ^is system of explanation is suggested by Plavell (1963^ pp. 213-14). 
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application of the term^ 'propositional logic', to the foUovlng argxsnent, if 
advanced by a person vho vas not aware of nor working within a cooplete combi- 
natorial framework: 

If p, then q. But not q. Therefore not p. 

We cannot be sure whether this interpretation of Piaget is correct, because 
it does not seem compatible with the distinction between propositional and class 
logic which we presented under "Points of Correspondence". If the interpretation 
is correct, then there is a vast difference between the two logics. 

2. A second point of noncorrespondence, one of which we are confident, is 
the greater simplicity of the system that he advocates. His system is more single 
in several different ways: 

a. The list of sixteen binary operations together with the interpretation 
given to the symbols shows that Piaget is accepting the reduction of the various 
logical operators to two: conjunction and negation.* Por exasple, for him, 'If 
p, then q' means Ihe same as 'It is not the case that both p and not q' • 3yB- 
bollcally, *p^q' = *P»q*« 

The acceptability of this reduction is a contemporary issue in logical theory. 
Comnon practice is to accept the above ^id>olic equivalence, but to deny that 
'pDq' ccptures the meaning of 'If p, then q'. Piaget makes no s\ich reservations, 
so far as we can tell. In case any of our readers would like to pursue this issue 
we mention the fact that prominent contenders are P. F. Strawson and P. H. Grice, 
both of Oxford University. Strawson opposes the reduction and Grice tends toward 
supporting it.** 

* Another way of looking at it is to say that the reduction is to 'v' and negation, 
but it amounts to essentially the same thing. 

** Strawson's views appear in his Introduction to Logical Theory (1952); Grice's 
views are as yet uxipublished. Strawson's book will get one started on this 
issue. 
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Our system differs from Piaget's in that ve do not accept this reduction and 
the consequent slsplification of logic. We have not attenqpted this simplification 
in our teaching of loglc^ hut in the tests we huilt to detexmine a person's 
kxxTvledge of logic we avoided using any items that would he answered incorrectly 
hy a person following the siaqaifled system. 

h. A second simplification lAilch Piaget has adopted is the merging of propo- 
sitions and idiat are called 'propositional functions ' . Olhis sispliflcation is 
not one that is accepted in the field of logic. First we must ifcat a 

propositional function is and then we shall indicate the possihle significance 
of this merging. 

Consider the statement, 'If a body floats, then it is ligiit'. Althou^ 
this odg^t at first appear to he a standard conditional statement in sentence 
(or propositional) logic, note that neitiier of the units can stand alone, neither 
of the units can meaningfully he affirmed or denied hy itself, if it retains the 
me a n ing that it has in the whole. In the original statement, the words 'a hody' 
do not refer to any particular body, so if we try to nwin* the group, *a body 
floats', stand alone, it does not make any assertion that can he called true or 
false. (Try to imagine how you would prove it true or false.) Since it does not 
say anything, it cannot stand alone. 

Ohe groiQ>8, »a body floats' and 'it is ll^t', are propositional functions 
in the original statement, ihey are not propositions or sentences, given the 
ttea n lng they have in tiiat o ri g in al statement, because they cannot stand Mm e 
without being given a change in meaning. 

Id his analysis of In held e r's floating bodies eaperlment, treats the 
statement, 'If a body floats, then it is li^t', as a statement in jaopositional 
logic, and is enabled to do so by merging his propositional functions and pr oposi* 




tlons. 
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MOV m4^t he want to be able to treat such a atateaent aa one of propo- 
sitional logic? Ihla ia a difficult qjueation and ve can only hazard a gueaa, a 
gueaa that doea fit in vith an earlier-auggeated point of noneorreapondence> hia 
coid>initorial criterion. 

Mote that the atatenent, 'If a body floata, then it ia lic^t* meana roui^ly 
the aaae aa 'All floating bodiea are light*> the latter clearly being a atatesent 
in claaa logic. Given theae rou^ily equivalent atatenenta^ a peraon ia ffee to 
\iae either one he viahea as an interpretation of the thought that all floating 
bodiea are lig^t. Hov if for deciding idiether the logic in use ia propoaitional 
or clasa reasoning# his criterion# is# say# the coabinitorial criterion# then he 
can adjust the fom of the sentence selected to fit the decision called for by 
the criterion. 

To be nore specific# suppose that on the basis of the subject's total be- 
havior# ve decide that he is operating vithin a fkaaevork that includes all the 
possible coid>inBtion8. ihen ve decide that the logic is propositional and ve 
use the if-then fom to represent the thoue^t that all floating bodies are light, 
liiidi he presunably is entertaining as an hypothesis. Me say that he is con- 
sidering the viev, 'If a body floats# then it is li^t'. 

SiQpose on Ibe other hand that the subject is not operating vithin a ftaae- 
vork tiiat considers all the possible coahinaticms, then ve judge tiie reasoning to 
be class reasoning and pick the class form of the thought that all floatii^ bodies 
are light. Ve say that the subject is considering the viev, 'All floatii^ bodies 
are light'. 

Fezhaps Piaget did not merge propositions and propositional functions for 
this reason# but so merging does enable him to use the cosbinatorial criterion 
and still roughly conform to establlAhed usage of - tiie vords# 'propositional' and 
'class'. 

Ihis merging of propositions and propositional functions is soiaething ve 
avoided in theory and tried to avoid in practice. Hence his simplification 
makes a difference between the sentence logic that ve tau^t and the propositioiial 
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logic that he investigated. 

c. A last 8iai>lillcstion is Piaget's apjMirent reduction of aletfaic logic 
(see page II-7) to ordinary propositional logic. He stretches his syBftK>lism to 
cover iBOves in alethic logic. Jbr exa^ple he wants to let 'p*<i. v p.<i* naan 
that each conjunction^ *P«q* and *p.qS represents a possible state of affairs. 
5Die standard systolic logic interpretation is that at least one is true^ not 
that each is possible, ahat Piaget also holds the standard interpretation is 
shown in his ea^lanation of *p v q*: "Disjunction £ v £ signifies that £ is 

true or g is true or both are true." (1958, p. 296). He does not in this 
interpretation say that each is possible. 

In his ejqplanation of the floating bodies ej^erinent, however, he does so 
interpret idiat he calls disjunction. Otherwise the argunent that he endorses 
is invalid. !Ihe argunent syiibolized goes as follows: 

Aremise: 

p.q. V p.q 

Conclusion: 

It is false that P 3 q. 

In the standard interpretation of the eyid)ol8, that argusKnt is invalid. But 
if the prenise is to be Interpreted as saying that p.q is possible and that 
p.q is possible, then it ^ false that poq.* That is, if it is possible that 
p and not q, 'ttien p does not Inply q, other things being equal. So Pi^et has 
avoided the coeiplexities of an additional synbolisn and set of rules by trying 
to include aleUiic logic ^fsholism and rules in his basic set. 

Oils treatwnt on his pert is ezeaqplified, aaong other places, in his 
analysis of the results of tte floating bodies experinent. In the particular 
discussion we want to present he assigns the variables as follows: "£ ... 

the assertion that the bodies will float and ^ ••• why factor associated 

with £ — for emple li^^tness (absolute)...." (1958, pp. 39-l«)). 




* Assunlng that *p* and *q* stand for propositional functions. 
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The statement being disproven in this selection Is represented by 'p3q'. 
Presumably this Is to mean> 'If a body floats^ then It Is ll£^t'.* 

Kov with all that Introduction, we hope It Is clear that In this passage 
he Is attempting to let his symbolism fit slethlc logic: 

Hie subject jsay note the two possibilities combined (p«q) v (p«q)— 
l«e>, of p.(q V q) — which constitutes the operation we may speak of as 
the affirmation of p Independently of the truth or falsity of q. But 
this operation contains p.q and amounts to discarding poq* Hils Is what 
Fran, for example, says lAien he declares that "the wood can be heavy (or 
llC^t) and It floats"... (1938, p. ko). 

The reasoning that Piaget Is describing here gees like this: 

It Is possible for something to float and be llc^t; It Is also pos- 
sible for something to float and not be ll^bt. Therefore It Is not the 
case that If something floats. It Is ll^bt* 

This argument seems legitimate, but it Is not an argument In propositional 
logic. Arguments dealing with possibilities In this way are to be Judged by 
the rules of slethlc logic (which are not yet well worked out, by the way). 

In subsuming slethlc logic under propositional logic, Piaget has done some 
siiqplliying lAiich we have not done in our presentation of logic. Instead we 
have avoided slethlc logic. 

Suamaiy . 

Thus there are points of simllari'ty and points of difference between the 
logic with idiich we worked and the logic reported on by Piaget. Similarities 
are that we both seem to be dealing with logic, that we both draw a distinction 
Between two l^fpcs of logic, and that the distinction appears similar. A pos- 
sible point of difference Is his use of the cooiblnltorlal system criterion in 
drawing the distinction between class and propositional logic. A definite 
point of difference Is the greater simpllcl'fy of ttie system he uses. This 
simplicity appears in the reduction of propositional logic to two basic 



♦ Let us neglect the difficulties in his assignment of the variables, i.e., his 
merging of propositions and prqposltional functions, and his neglect of the dif- 
ference between propositions and concepts. ( *p* is here assigned by him to a 
proposition (or sentence), 'q' to a cc^ept (or term)). nim to a 
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operators^ in the merging of propositions and propositional functions, and in 
the merging of alethic logic and propositional logic. We are of the opinion 
that our results con probably be compared with Piaget’s, but want to retain 
as qualifications the points of non-correspondence specified above. 

A further difference, not in logics, but in intensity of analysis, can be 
foimd in our attempt to study separately various principles of the l^ypes of 
logic with \diich ve worked. Piaget, on the other hand, tends to speak 
globally about his two lypes of logic. 

£. CBAFTER SUM4AB3T 

In this chapter we have outlined the conception of critical thinking under 
^ich we are working, have suggested the significant role that deductive logic 
plays in this conception of critical thinking, have sketched out a number of 
types of deductive logic, hove elaborated on two very basic types, and have 
compared these two types with Piaget’s conception of similar types. Primarily 
in order to work within a small organization and thus maintain control of what 
happens, and in order to work with ‘^rpes of logic that ore both significant and 
fairly well worked out, we picked class and conditional logic as the two on 
idiich we would concentrate. 

Conditional logic is in our view the most important part of TJhat we call 
sentence logic and Tdiat is often called propositional logic. We have Judged 
Piaget’s class logic and propositional logic similar enou^ to our class logic 
and sentence logic to declare them roughly compsrable, so, with sene reserva- 
tions, we feel that that we have learned about the development of knowledge of 
logic does hove a bearing on that Piaget has claimed. 







CHAFm III. Basic Data on Subjects 

So that our readers vlU^ in reading about the results^ have an idea about 
from, vhom these results were secured, we are presenting basic infbxmation about 
the subjects before we attenqpt to present, discuss, and interpret the results 
in detail. In this chapter we shall indicate the institutional nature of the 
groiQ)s with Tdiom dealt, shall comment idiere necessary on the instruments we 
used (except for the logic tests, to which we devote the entire next chapter), 
and then shall provide sianmary information about our subjects. In order that 
the grouping and categorizing be intelligible, we Ehall sketch in reasons for 
some of the decisions. 

A. THE GBOUFS l^TH WHICH WE WORKED 

1. The "LPr»s" . 

At each of Ihe grades 4-12 we selected one class-size groiqp with which to 
vork intensively . With each of these groups one of the mesibers on our staff 
worked for one period per day (around 40-50 minutes) for four weeks (20 instruc- 
tional days). Approximately three quarters of this time was devoted to the 
teaching of logic. The other quarter was in general devoted to advancing the 
subject matter that was ordinarily scheduled for that time. 

Because we discovered in our pilot study that it was not possible to teach 
thorou^ily even one type of logic in the time we had available, we decided to 
alternate years between the two types we selected. Class logic was tau^t in 
grades 4, 6, 8, 10, and 12. Conditional logic was taught in grades 5, 7, 9, 
and 11. We shall label these nine groups our *LDT* gxxnqis, indicating groups 
to ^ich logic was j^liberately Tau^t. 

Our LDT»s were selected from an T^iper New York State school system with a 
student population of about 8,000 in grades K-12. The district is called a ‘city 
school district' but also comprises suburban and rural communities which were 
added in various centralization proceedings over the last thirty years. About one 
half of the students live in the city. The city itself has a population of about 
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14^300^ plus about 14^300 college students. Hhe Kain industry in this coonunity 
is college education^ but there are a nusiber of medium- and small-sized factories 
as veil. 

No census figures that indicate the nature of the school district population 
are available^ since in Nev York State^ the boundaries of school districts do not 
generally coincide with political boundaries. But ve can give figures that indi- 
cate some things about the occupational nature of the population of the city. For 
comparison purposes ve are also supplying similar figures for Nev York State and the 
United States. 

TABLE III-l. Percentage Occig>ational Make-Up of City, Nev York State and the United 



States* 


Occupation 


City 


Nev York 
State 


United 

States 


1. Professional, Technical and Kindred Workers 


25.7 


12.5 


10.8 


2. Clerical and Kindred 


18.9 


18.1 


14.4 


3* Service vorkers, except private household 


16.8 


9.3 


8.4 


4. Craftsman, Foreman and Kindred Workers 


7.1 


12.4 


13.5 


3. Operatives and Kindred Workers 


6.8 


18.1 


18.4 


6. Managers, Officials and Proprietors 


5-9 


9.0 


8.4 


7* Sales Workers 


5.3 


7.3 


7.2 


8. Unenployed 


3-5 


5-2 


4.9 


9* Miscellaneous 


13.5 


13.3 


18.8 



*U.S. Bureau of the Census. U. S. Census of Population; i960 . Vol. I, Charac- 
teristics of the Population . Part Nev York. U.S. Government Printing 
Office, Part I, United States Sumnary, Washington, D. C., I963. 

In this ci*ty there is a higher percentage of professional, technical and kindred 
vorkers than in the state and the nation. 

We tried to secure classes that vould typify this school system, and, to the 

Q extent that this school system is typical of the United States, that voald be more 
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brosdiy '^fpicsl* wbb difficult to srrsnge^ given the numerous pressures 

that Inpinge upon the public school administrator, but the people with whom we 
worked were very helpful and did the best they could. 

Our classes in grades 4-6 were from an elementary school which contained a 
broad distribution of backgrounds. The classes were existing units which were 
turned over to our staff members for the designated period. 

^ In grades 7-8, the classes made available to us were arithmetic, and the 
9th grade class composed of students supposedly with sufficient ability to be 
taking algebra, but \dio were not doing so for one reason or another. 

Because it was not x>ossible to take so much time from the com'se of instruc- 
tion in high school classes of average or above-average ability (the New York 
State Regents examinations were a factor operating here), our classes at 1iie 
high school grades were composed of volunteers from study halls. 

2. The “LNBT-l’s” . 

At each grade level from the same school system we re(|uested a fairly com- 
parable class in \diich logic was Not Deliberately Taught. Hence the designation, 
LNDT . Since there was another set of students to \diich logic was not directly 
taught, we added the numeral '1* to the designation. The LNDT-l*s served two 
purposes: to provide more subjects for our study of the natural-cultxiral develop- 
ment of knowledge of logic, and to provide a check on the efficacy of our teaching. 
All the data that we have on the LIXT's we also have on the INDT-l's. 

3» Ohe LN1XP-2'8 . 

Another group of students, the UfDT-2*s, to vhom we did not teach logic was 
selected from a nearby school system. It is in an area that is part of the larger 

community of which the city is the hub, and, although it is a rural community, it 
is a suburb of the city. 

We did not gather the same data on the INBT-2*8 as on the others. A socio« 

economic status index was not secured, and the IQ scores were not from the same 
o 
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test. These subjects vere used prinarily for data on the natural-cultural develop- 
ment of knovledgc of logic. We attempted to test all the students in grades 4-12 
in the school system with our logic tests. 

B. IHE SOURCES OF OUR DATA, • 

We have the following data on our subjects: 

a. Grade level in school. 

b • Chronological age . 

c. Sex. 

d. I.Q. score. 

e. An index of socio-economic status (except LNDT-2‘s). 

f. Pre-test and post-test scores on 'ttie appropriate Cornell 
Deduction Test. 

In Ihis section we shall discuss^ where appropriate, the instruments and/or 
technl^es we used to gather these data. However, we shall not here be concerned 
in any detail with the instruments that we developed, the conditional and class 
reasoning tests, since a separate chapter is devoted to them. 

!• Readily Obtainable Information . 

Hie first three items, grade level, chronological age, and sex are routinely 
available from school records. Chronological age was determined as of the date 
on idiich the pre-test was given, which is approximately the date on which instruc- 
tion at the given grade level started for the LDT’s of that grade level. Hiis 
occurred in February or March of 1964, depending on the schedule for that 
particular grade. 

I*Q, score, althou^ on the school records, required more discretion in 
data gathering. For the U>T'e and LNDT-l's, Which were from the same school 
system, we chose the latest available score on the Lorge-lhomdike Intelligence 
Teste. Where both verbal and non-verbal scores were available, we took the 
arithmetic mean; jAitre only one was available we used that. Jburth graders were 

o 
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tested vlth level 2 Igige Piomdlke^ fifth and sixth graders vith level 3, and 
the rest with level 4. All I«Q* testing had been done vith in the previous tso 
years except for that of the eleventh and twelfth graders, most of vhon were 
tested in sixth grade and eigiith grade respectively. Thus ve were dble to se« 

cure fairly con^arable scores from the school*s recoards for the 1D!P*8 and 
£ND1!-1*8. 

Ihe use that we made of the USOT-2's did not require the sane I.Q. test. 

Ihe school system from \4iich they were drawn used a wide assortment of tests. 

'he majority of the scores of I3«I)T-2*s are on the California Test of Mental 
Mat^ty, 5TS, but because many are from other tests, the mean IQ*s which we 
report should be understood to be rou^ estimates. 

2. Less dily Obtainable Information . 

a* Spcio-econo mic status . Because of our interest in the relationship 
between socio-economic status (henceforth called »SES*) and knowledge of logic, 
we made a rudimentary attempt to secure for each LOT and UJKP-1 a number that 
bears a relation to SES. Ihis number is based iq)on the occ\;pation of the 
parent, making use of Warner’s seven-place occupational scale (I9k9, pp; liiO-4l). 
OccT^tions with the hipest socio-economic status receive a rating of ^ and 
those with the lowest socio-economic status receive a rating of 7. 

Two raters separately applied Warner’s seven-point scale to the occi^ation 
listed in the school records for each student’s father, or mother if Ae was the 
principal means of siqjport. When the occupation did not appear in the school 
records, we made^ effort, ^ich was generally successful, to obtain it. We 
did not, however, approach the subject’s parents and ask them, feeling that this 
approach would be resented, unless we devoted more time to it than we had avaU- 
able. In exactly 11 cases out of ^126 (the total nuniber of LLT's and LRDT-l's), 
we were unable to determine the occigpation with enou^ specificity to nwlr an 
assignment. In those cases we made an arbitrary assignment of 6, because it 

o 
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has been our experience that lack of information or information that is too vague 
ie a good indicator of low socio-economic status. Naturally this assunptlon does 
not hold in every case, so we made every effort to keep our use of it to a minimum. 

We made the following additional amendments ?nd/or additions to the Warner 
scheme as presented on pp. Ili0-ln of Social Claes in America . Ihese changes were 
made on the basis of our knowledge of the prestige structure of this community, 
with uhich each rater has had considerable experience. 

1. Unemployed people are not given a number in the Warner scheme. Althou^ 
inevitably there will be some errors in so k)ing, we assigned them the number 7 . 

At this time in the economic life of our country, this assignment is more realistic 
than it would have been, say, during the Depression. 

2 . People in the armed forces are not given a number in the Warner scheme. 

We assigned the number 3 to officers (rank unspecified) and 6 to enlisted men. 

3* College teachers also are not assigned a nunber. To them we assigned the 
number 1. 

Warner assigned the number 5 to dime store clerks. We changed that to 6 . 
5* Warner assigned the nunber 5 to hardware salesmen. We changed that to k. 
6 . As we interpret his chart, there was no number assigned to qualified 
electricians who do not own their own businesses. We assignr'’. the number 5 , 

since he assigned this number to carpenters and plumbers idio do not own their 
own businesses. 

After each rater had practice-rated a class from a previous study, the raters 

discussed their differences of opinion, which were small in magnitude and nimber, 

settled \q)on the above list of adi^slanents to the Warner scale, and proceeded 

independently to rate all U 28 LDP’s and LNDT-l’s. For purposes of estimating 

reliability of our ratings, we computed a Pearson product-moment correlation 

coefficient between the two sets of ratings. It was .95, indicating hi^ scorer 
reliability. 

o 
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Since we were not able to uee both sets of ratings^ we adopted the simple 
procedure of flipping a coin to select one set, which was used. 

Cornell Deduction Tests * There were two Cornell fiduction Tests, 

"Obe Cornell Class -Reasoning Test, itomi X,” and "Bie Cornell Conditional-Beasoning 
Test, Form X.” Die former was administered as a pre-test immediately before 
teaching the LET’S for the grade, and as a poet-test six weeks after the con^e- 
tion of teaching to all students in grades 4, 6, 8, 10, and 12 ; the latter was 
administered similarly to all students in grades 5, 7, 9, and 11. 

In this chapter we shall report only total scores, which were computed making 
use of a correction formula. The score reported is ri^ts minus J wrongs plus 27 
(R- W/2 + 27)» Each test had 72 itens making Ibe possible range run frcmi minus 9 
to plus* 99* Biie scoring procedure and many other features of the test will be 

discussed in the next chapter. Other scores and their analyses will be presented 
in o'Uier chapters. 

Diat completes the presentation of th- sources of data, except of course for 
the discussion of the two logic tests which will follow in the next chapter. 

C. THE FIGURES. 

Given the previous descriptions of the groips and methods and/or instru- 
ments for securing data, the following table provides a general picture of the sort 
of subjects with whom we worked. Altogether there were 803 subjects, 217 LDT’s, 

211 UiET-l's, and 375 LNDT-2’s. Mean IQ for all subjects is roughly U4* and mean 
SES rating for LET’S and UJET-l's conbined is 3 - 1 - Thus our subjects are above 
average, as one mi^t expect for a college community In the Hbrtheast. 



^We say {•roughly" because purity of IQ tests is not achieved because of the LNDT-2’3. 
o 
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TABLE III- 3 * Basic Information on Our Subjects - cont. 



CHAFEER IV. The Cornell Deduction Tests 

In order to measure our subject's knovledge of logic^ ve found it neces- 
sary to develop our own inslnruments^ tiiere being no instruments available that 
suited our purposes. Most existing instruments which are partly or idioUy aimed 
at testing for knowledge of logic do so on a rather global scale, and do not 
attempt to secure separate measures of basic principles of logic. A key feature 
of our approach is our interest in specific principles of logic on the assumption 
that principles vary in the ease with which, and the level on which, they are 
acquired. 

Two tests Tdiich do attempt separate interpretation for specific principles 
of logic and which made at least some atteopt at comprehensiveness ore worthy 

of mention here. Unfortunately neither of these were usable, fbr reasons which 
we shall give. 

Id 1919 Cyril Burt jnibllshed an instrument called "Graded Seasoning Tests" 
for use with individuals as opposed to groups. He did in developing the instru- 
ment attempt to make a ccoprehensive coverage of basic principles of certain 
types of logic. This instrument provided Burt with data which he used to 
support statements about ^en children develop certain logical abilities (Burt, 
1919)* However we were not able to use his instrument for several reasons: 

1. Time limitations required the use of a groip test. Possibly Burt's 
instrument is adaptable (Pairgrieve, 1921), but we did not try because of other 
difficulties with it, given our purposes. 

2. It calls on Ihe person being tested to invent and supply a premise 
(sometimes called a "suppressed premise"). The trouble here is that any argu- 
ment can be made valid by supplying some premise . IMess the individual is 

tested individually it is difficult to see how to find out just what premise 
he was adding. 

3* Bie final product was held by Burt to provide an overall score. Siere 
is no score possible on a type or sub-type. 

4. Often a given form of argument is tested for by only one or two items. 
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Granted that with individual testing, the examiner can by aski^ the right ques- 
tions often get a fairly good idea of the nature of a person's difflcul'ty with 
an item, but there is danger that something else will without detection affect 
the response. 

In a Hi.D. thesis completed in I961, Shirley Hill reported on an instru- 
ment that she developed in order to investigate the degree of knowledge of logic 
anong 6, T, and 8 year olds. Her test appears to be satisfactory for adminis- 
tration to groups, and is based on an attempt at a comprehensive coverage of 
basic principles of valid arguments in class and sentence logic, but it was still 
not satisfactory for our purposes. 

The test was built so that the most is^rtant feature of the distincticm 
between a valid and invalid argument could not be tested for. All proposed 
conclusions either followed necessarily or contradicted the premises. 

Althou^ arguments in T^ich the conclusion contradicts the premises are a 
sub-class of invalid arguments, a more inportant sub-class is the groiq) of argu- 
ments in \hich the conclusion does not follow, but also in which the conclusion 
does not contradict the premises. People are rarely trapped ip-^o thinking that 
an argument is valid in Tdiich the conclusion actually contradicts the premises. 
The iii5)ortant distinction is between a valid argument and between one Which 
someone might be inclined to call valid, but Tdiich really is not valid. Ohe 
mastery of this distinction is not tested for in iliis test. Thus it tdb was 
unsatisfactory for our purposes. 

In this chapter we shall describe the features that we deliberately built 
into our instruments, and the rationale for having these features; we 
present information bearing on their reliability and validity; and lastly we 
shall sojggest some lines along ^ich we feel further development is possible. 



A. THE STRUC!nJH£ OF THE TESTS 



The two tests that we developed are caUed "The Cornell Class-Beasoniiig 
Test, Form X" and ’’The Cornell Conditional-Reasoning Tfest, Ebim X ”. They may 
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be found in the Appendix to this report. Each is a 72-item multiple-choice test 
designed for use with any of the grades with ^ich we were concerned (grades 
4-12 )v Each item in virtue of its logical form was e:qpected to play a role in 
measuring a person’s knowledge of some principle or combination of principles; 
in virtue of its content it was e:qpected to contribute to one of the three con- 
tent components that we built into tiie test. First we shai i discuss the logiccOL 
form of the items; then we shall discuss their content. 

1* Ihe Logical Form of the Items . 

Each test was constructed in such a manner that it tested for knowledge of 
twelve principles or conibinations of principles. Six items were assigned to 
each principle or combination of principles. Hencefortii we shall refer to 
set of six such items as an 'item group*. Ohere are therefore twelve item 
groig>s in each test. 

In the conditional reasoning test the list of principles or <*nwih5 n** t1 o ns 
embodied by the items corresponds very closely to the list of basic principles 
of conditional reasoning given in Chapter II. In order that we could have some 
combinations of principles ve left the twelfth one off, on the assun 5 >tion that 
it is less often needed than the others; and used the eleventh one only in a 
combination with another. Principles One through Ten, however, each had item 
groups exclusively assigned to them. Table IV-1 gives the selection and ex- 
tent of cd&ibination of principles of conditional reasoning. 

In the class reasoning test each of the basic principles had an item group 
assigned to it exclusively, except Principle lEiree which had two item groins 
assigned to it. Item groins ^3 and =§h embody syznbolized arguments that are dif- 
ferent enou^ to Justify being distinguished, though they are both covered by 
Principle Oliree. Ohus nine item groi 5 >s are assigned to specific principles of 
class logic. Ohe other three item groups are assigned to combinations of the 
principles or to double applications of the principles. See Tab3e IV-2 for the 
specific nature of the assignment. 
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An additional logical principle ^ich is often invoked in both tests is the 
principle of double negation: that tM> negatives make a positive. EJ5)licitly the 

I 

principle goes as follows: "If it is false that a statement is false, then the 
statement is true, and if a statement is true, then it is mse that it is false." 

Now there are qualifications to be added to this principle, but this slaqae state- j 

ment of it holds in the cases in \diich it is needed. We do not consider this f 

f 

principle to be tested for in this test, but rather assume that it is mastered. 

To the extent that our assunption is false, the test is also a test for this prin- 

\ 

ciple . 

2. The Three Ctontent Components . 

m 

In a ftrequently-mentioned study Wilkins (1928) specified four types of con- 
tent and atteapted to see idiich kind made syllogisms more difficult. We have 

j 

selected her first, second, and fourth types for our tests. B»r four l^es are: i 

a. Concrete familiar, in Tdiich the content mentioned is concrete articles I 

and qualities with vhich the subject has been associated. However, no statements 
are made which the subject has reason to believe to be true or false, because the 
specific objects referred to are not Jincjwn the subject. For example instead of ; 

saying. All cats are black , a statement with which the subject is likely to 5 

disagree, a statement might be, "Mary*s cats are black". The latter is less I 

likely to meet with agreement or disagreement, although there is still the pos- I 

i 

sibility of disagreement, if the subject identifies the Mary of the statement \ 

with some Jfary he knows. i 

r 

I 

b. gymbolic, ih \Hiich symbols like 'x*, *y», »A», and »B» are used in key I 

places, instead of terms that refer to particular objects. An example of a sen- | 

tence using synibolic content is Ihe following: *A11 A*s are B*s.* I 

I 

c. tfaf^lto^ in which the basic terms are scientific terms with which the j 
subject is expected to be unfamiliar, or are "nonsense words invented to sound 1 

like scientific terms" (p. 13). For exanple, »A11 hentras are globiculous*, is | 
a sentence with unfamiliar content. 
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Sugge stive > in vhlch the content Is familiar, but the truth status of this 
content is knovn by the subject. Furthermore, "the truth or falsity of these state- 
ments /conclusion]^ was at variance with their validity." (p. 13 ). In other words 
the truth status of the conclusion was different frcmi the validity status of the 
argument. A person mlg^t be tempted to mcdrk an argument valid because he agrees 
with the conclusion, or invalid because he disagrees with It. 

In our tests the three of Wilkins' four content components that we used are the 
ones we feel a person is most likely to encounter in realistic reasoning situations 
in ^ich his reasoning abili'^ will make a difference. Our three content components 
are the concrete familiar, the symbolic, and the suggestive. We do not think that 
What she calls 'unfamiliar' content is likely to be encountered in situations that 
make a difference. If a person meets arguments with such content, he will generally 
not know vhat to do with the conclusion anyway. 

nils is not to say that arguments with such content are useless in teaching, 
for they can be very helpflil in isolating questions of form, and *Uiey can be useful 
in arousing interest, if handled properly. Rirthermore it mlg^it well be that they 
are good indicators of grasp of fom. But ultimately our interest is a practical 
one, so we, given the testing time limits forced ii^n us by the situation, did not 
include this '^fpe of content in our tests. 

Ihe six items in each item grotq9 were assigned to the three content components 
in the following way. Four of tiie items had concrete familiar c(xitent, a fifth 
had sysholic content, and a sixth had suggestive content. Ttere were some formal 
variations among these. Incidentally, which we shall describe next. 

A basic logical symbolic form was assigned to each item group. It appears in 
Column 3 iQ TSble IV-1 md TSble IV-2. !Diis basic form was used for two of tiie 
concrete familial* items, the synholic item, and the suggestive item. Ihe third 
and fourth c<mcrete familiar items eidDodied slight formal changes^ in order to pro- 
vide greater variety in the representatives of each principle or coehination. 

o 

ERIC 
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Because class and conditional reasoning differ in their basic structure, these 
variations diffez^d. 

In the conditional reasoning test the third concrete familiar item negated 
the conclusion, unless there were good reasons not to do so* lhat is, if the 
conclusion called for by the basic symbolic foim is positive, the one provided 
is negative; and if the conclusion called for is negative, then the one pro- 
vided is positive; unelss, as we said, there are good reasons not to do so* 

What are the reasons? Ihere are tuo: 

1* If the basic form is invalid, then denying the conclusion reduces the 
temptation to Judge it valid, ma k i ng the item considerably easier* So for those 

four item groxqis in ^ich the basic foim is Invalid, the third concrete familiar 
item conforms to the basic form* 

2* If the conclusion is Itself a conditional statement, a of it 

becomes aakHard to state* Hbte lhat the denial of "If Sam misses the bus, Ihen 
he will walk to school" is not "If Sam misses the bus, he will not walk to 
school , thiCh is not afdoiard to state* Instead the denial is, "It is not the 
case that if Sam misses the bus, he will walk to school", vhidi is cwkifard. 

Hence the third concrete familiar items conformed to the basic logical form in 
two additional cases (GroiqDS 5 **n d 6)* 

The fourth concrete familiar item in conditional reasoning varied from 
the basic form by having one of the basic sentences negated throutftioiit, and by 
having premises in different order, ihen there are tao or more premises* Table 
IV-2 presents syiobolic representation of this variation* 

In class reasoning the Ihird concrete familiar item contained at least one 
class moAerdiip statement in the premises instead of all class inclusion and 
exclusion* A class meiher^ip statement asserts the meshership or noiaeAeraitip 

of one tting in a class, thereas a class inclusion or exclusion statement speaks 
about the relation between classes* 

o 

ERIC 
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She fourth eraerete familiar item in t4ie claaa reasoning test contained at 
least one statement of partial inclusion* 

Ihe conposition of each item group is presented in Tables IV-1 and IV.2* 

3* Item Eormat . 

We sought an item format that uould meet the following criteria: 

a. Provide a way for a subject to show that he knows that a proposed conclusion 
does not foUow, even though it does not contradict the premises. 

b. Avoid technical language, yet ask whether an argument is valid. 

c. Provide more than two alternatives in multiple choice form. 

d. Provide fairly egiial nunbers of each type of answer. 

e. Allow for separation of different items of the same logical form. 

f. Be understandable to fourth graders without insulting twelfth graders. 

g* Avoid confusing truth and validity. 

h. Not require elaborate directions. 

i. Hot require an elaborate scoring procedure* 

j* MLnifflize irrelevKit errors* 

After much experimentation and discussion we settled iq>on a format idiich 
the subject to siq^pose (a) certain premise(s), and to decide whether, on the basis of 
the supposition, a further thing would be true. We shall call this llirther thing 
the ‘proposed statement* and the original supposition Ihe ‘siqposed statement(s). 
Ohere are three possible answers, ‘Yes', ‘No*, and •Maybe*, each of which is ex- 
plained in the directions by means of six sample problems. Pbrthermore a brief 
ej^anation of each response appears at the top of every page* 

3he response * Yes * indicates that, the subject thinks the proposed statement 
follows necessarily. *Ho* signifies that the proposed statement contradicts what 
has gone before. 'Maybe* means that the proposed statement neither follows neces- 
sarily nor contxmdicts — that its truth is not necessarily determined by the estab- 
lishment of the truth of the premises. 

o 

ERIC 
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We introauced the 'No' response partly in order to make possible three choices 
instead of the two suggested by the distinction between validity and Invalidity. 

Wie wanted three choices in order to lessen the attractiveness of wild guessing and to 
lessen the chances of its success. We were able to introduce this 'No' response as 
a correct answer by taking conclusions to valid arguments and ttien denying tiiem. 

For the *Ho' response, the proposed statement is then a denial of a conclusion that 
follows necessarily from the supposed statenient(s). A second reason for having a 
'No* response is that doing so enabled us to avoid a preponderance of 'Yes' answers 
over 'Maybe* answers. 

In introducing this 'No* response we were well aware that we were running a 
risk. Ihere is an additional principle involved in each of these items: !Ehat the 
denial of a statement which follows necessarily from supposed statements can not be 
accepted, if the supposition is accepted. Ihis principle is elementary, but it must 
be Invoked. Failure to invoke it, as contrasted with failure to know the basic 
principle(s), could explain errors that are made. Ohus there is an additional 

possibilily of error of measurement. We feel that the advantages gained are worth 
the risk. 

Bie reader is referred to the copies of the tests in the Appendix to see the 
saiple problems and initial directions. Let it suffice here to present the tpp-of- 
the-page interpretation of the answers and an item from the class reasoning test: 



Here is a r eminde r of the meaning of ttie possible answers: 

A. YES It must be true. 

B. NO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enough to be certain whether it is "YES" or "HD". 



7* Siqppose you know that 



All "Oie cars in the garage are Mr. &nl'Ui'8. 
All Nr. Smith's cars are Fords. 

Then would this be true? 

All of the cars in the garage are Fords. 



A. YES 

B. NO 

C. MAYBE 



o 
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In order to avoid poselble confusloiv separate answer sheets were not used. Subjects 
circled an answer on the right. 

Although there are maoy strong arguments on both sides we directed students not 
to guess wildly and used a scoring formula. We did this because^ in addition to 
the standard arguments > we feel Ihat a critical ti^inking test should not encourage 
wild guessing, and that part of being a critical thinker is knowing when you do not 
know. 

!Ihe following direction appears on the front of both teste; 

DO NOT GUESS WHELT . There is a scoring penally for guessing wrong. 

If you think you have the answer, but are not sixre, mark that answer. 

But if you have no idea, then skip the qiuestion. 

The scoring formula ^ich we used is; Score - R - W/2 + 2J. The 27 was added in 
order to make negative scores unlikely. 

4. Item Arrangement . 

The first six items are sample items in each test. They are drawn from other 
'^rp^s of logic than class and conditional reasoning. Items 7 throu^ 78 in each test 
are divided in two parts, although the subject is not informed of this fact. The 
first part contains the item groins for the six easiest forms, as determined in our 
tryouts. The second part contains the item groups for the more difficult forms. 

Thus it might be possible to cut the test in half for testing younger diildren or 
for otiier puiposes. 

Since our item groups are generally numbered in reccmmended teaching order, and 
not necessarily in order of increasing test difficulty, some of the gro\Q>s in the 
second half of the conditional test represent principles in the first six on the 
teaching order list. 

Items were arranged so that no two items from the same item group appeared on 
the same page, and so that the distribution of answers would appear fairly random 
to the subjects. The specific assigmaent of items to test item mmhers is atKnm in 
Tlables IV-1 and IV-2. 



B* OPBRASIQSAL IXESF^NTEIOHS OP 'KASTEEV OP X PBIBCIPUB* 

Our basic interest is in detetnining whether or not a given principle of 
logic has been nastered. Since there are no established criteria fbr suOh 

a detanaination^vadevelqped our cm, realizing of course that our results are 
correct only to the extent that our criteria are satisfactoxy and that the ques- 
tion of the satisfactoriness of our criteria is not strictly an enqjirical natter. 

It is partly also a natter of the neaning of the tern 'nasteiy* and of the neaning 
of Uie principle involved. 

Since there is no outside criterion, one principal enpirical guestion is 
i*ether the criterion (derates reliably (or sbether it is based ignn a reli*le 
measure). Anottier eapirical guestion nicdit be ahetiier the criterion-based judg- 
mente are in agreement vith the Judgments of ej^erts, but of course their Judg. 
ments must be based vgoo the non.e»g>lrical meaning features mentioned above. 

Since these Judgments about meaning regiiire a great deal of attention to the 
<d^Uon of the parUcular criterion and there is a limit to the amount of ex- 
pertise that can be exercised, ue did not go outside our oun staff tor su^ ex- 

pert JudBients. (Vfe did seek outside opinion about the validi^ of the total 
tests and vill present that later. ) 

Shat a person interested in our reseanh must do is to our criteria 

in very qiecific terms and decide for himself vhether they reasonably conftnm to 
the meaning of the ihrase, •masteiy of x principle'. In ahort the non-avirical 
assets of our criteria are not aibitxaxy, but they ate matters of intellleent 
Judgnent rather than eaq^irical investigation. 

Our ciiteria took the fom of cperaUonal definitions, ihe 
definition structure that ue used is as follow (absfeneted £tn> 

19ftc): Krst there is a specification of an operation perltonAle by an 
investigator, this specification appears in a conditional clsiMe. laxt 
cc«s a statwent of sow sort of relatiamlii^ betneen the — of speel. 

fldble abservstions end the eppllcation of the term being defined. In 
effeet the (^eratlonal definition gives an incoi^lete ai^irieal intetpretatlw 
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of the meaning of an ahatract term^ because the relationship is claimed to hold 
\Aien the operation has been perfomed; but no claim is made about the status of 
the relationship at other times^ or ^en other operations have been performed* 

Furthermore the operational definition should have some explicit qualifiers 
like 'probably' and 'under standard conditions' if there is a reasonable chance 
that something mi^t go vrong in the measuring process. Since there ordinarily 
is such a chance in dealing vith human beings^ it is best to include such quali- 
fiers in our operational definitions. 

First ve shall give an informal presentation of one of our operational defi- 
nitions; then ve shall give the same definition formally; finally ve shall dis- 
cuss some dangers in our approach. 

Put informally the operational definitions of mastery of one of our princi- 
ples go as follows: Given that ve have administered the "Cornell Conditional 
Reasoning Test^ Form X” under standard conditions and have scored it according 
to the key given in Table IV-1. Then if a subject gets rlc^t at least five of 
itCTis 8^ l6^ 22, 29, and 39 f ^ can be fairly sure that he has mastered 
Mnclple ^ (Given an if-then sentence, the denial of the then-part implies the 
denial of Ihe if-part). Fur&ermore if he gets fever than four of those items 
ric^t, ve can be fairly sure that he has not mastered j^inciple fk. 

One mi^t choose to regard the foregoing as tvo operational definitions or 
as one. It does not matter. For convenience ve regard it as two operational 
definitions. Ihe distinction between them appears in the following pair of for- 
mal pperational definitions of the same principle. Ihe first gives a sufficient 
condition of mastery, given the operation; the second gives a necessary condition 
of mastery, given the operation: 

1. If 7 is given "The Cornell Conditional Reasoning Test, Foxis X" under 
standard conditions; then if Y answers correctly at least five of items 
8, 16, 22, 29, 35, and 39, Y has probably mastered Principle #4. 
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2. If y is given ”Ihe Cornell Conditional Reasoning Test, Form X" under 
standard conditions; then it is probable that Y has mastered Principle 
^ answers correctly at least four of these items: 8, l6, 22, 

29, "3^ and 39- 

These two operational definitions of ’mastery of Principle #U* served as our criteria 
for estimating the per cent of students at each grade level tdio had and had not 
mastered Principle #4 of conditional reasoning. We used similar operational 
definitions for each of the other principles for uhich we had a corresponding 
item group. 

It is important to note that the above pair of operational definitions does 
not i^pecify a decision for a subject \dio correctly answers exactly four of Hie items 
in an item group. If a subject correctly answers at least five, then he is judged 
to have mastered the principle. If he does not correctly answer at least four 
(that is, if he correctly answers three or fewer), then he is judged not to have 
mastered the principle. But the person who has a score of four is not put in either 
category. 

There is a reason for^ framing the operational definitions this way. Such people 
we think are borderline cases, so we have accommodated the operational definitions 
to this fact. We do not desire to be committed, even with the qualifications that 
exist in the definition, ^en a person answers correctly exactly four of an item 
group. We do not want to say that he has mastered the principle, and we do not want 
to say that he has not mastered the principle. We want to leave the question oj^n. 

One of the dangers in this operational specification of the meaning of ’mastery 
of y t^nciple* is that we ml^t be taken to have eidiausted the meaning of the 
;j^hrase with our necessary and sufficient conditions; that i&^ we might be taken to 
have equated the meaning of this jhrase with a finite set of "behaviors”, as people 
so often say. A careful examination of the logical form of our definitions should 
make it clear that we are not doing this. If we were to do so, then we would be 
conultted to saying Hiat no other test of mastery of these principles can attain 

o validity siamly by virtue of the meaning of 'masteiy of X principle ’ • 

ERIC 
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Furthexmore our qualifying terms^ 'probably' and 'under standard conditions' 
protect us from being unalterably committed to the view that a subject \iho by wild 
guessing answers correctly five of the six items in a group knows the principle. 

A behavioristic interpretation would commit one to such a view. Our Judging 
procedure will classify such a person as one lAio has mastered the principle^ but 
the looseness of our definition enables us to avoid such a commitment. 

In sumnary^ even though operationism is often associated with behaviorism^ 
we want it to be clear tbpt o\ir operational definitions should sot be so associated. 

A second danger in our approach arises from the number of items in an item 
group: six. The use of six items Instead of more represents a compromise that we 
struck. Pressures that operated to keep down the number of items were the need to 
avoid taking too much school time of our subjects, and the desirability of including 
a variety of principles and comibinations thereof. Given these pressures, together 
with the fact that our items are so directly and clearly related to their principles, 
a study of our tiyout test reliabilities made us willing to utilize part scores based 
upon six itams. This use of these part scores was fairly successful, from the point 
of view of reliability. For a discussion of the reliability of parts and idioles at 
each grade level, see the next section. 

A iiiird danger in our use of these operational definitions is the possible con- 
fusion with respect to those item groups \diich represent combinations of princ*'^les 
and with respect to Item Groups #3 and #4 of the class reasoning test, both of Which 
enibody Principle # 3 . 

We shall deal with the latter problem first. Since operational definitions do 
not present complete Interpretations of the meaning of terms, the double pair of 
operational definitions of 'mastery of Principle ^1^3' (class reasoning) siQplement 
each other. Does this imply that we must have coaplete agreement between these two 
item groiqps? 19o, it does not. Systematic and random variations, errors, and mis- 
understandings are bound to slip in. One does not even expect (nor achieve) complete 




agreement among theimoaietera of different ’^pes^ althou£^ they aare aiippoaedly 
meaauree of the same thing, teiq^erature, and are mentioned in operational defi* 
nitions of 'tenperature*. 

A glance of the difficulty index development on class reasoning Item Groups 
^3 aod ^ (Table IV-9# P* 3l) shows that these two item gro^ps are not vastly 
different from each other, althoug^i Item (hroup #4 appears more difficult, 
probably because of its greater con5)lexity. 

The other problem, that of confusion resulting from the combination of 
principles for some item groups, may be stated in two parts: 

1. The mastery of tdiich principle is being defined? 

2. When alternative combinations of principles can be used to Justify a cor- 
rect Judgment for a given item group, \diidti of the alternatives is being defined? 

The first part of the problem can be answered by stating that it is ‘masteiy 
of the conibination of Principles X and Y* that Is being defined. 

The second part of the problem is not one we have been able to solve to our 
satisfaction. It is probably the result of the redundance, mentioned in Chipter 
II, Ihat is built into the list of principles. This redun<iance is the cost of 
Intelligibili'^ and utility for teaching. 

One way out is to say that the necessary condition operational definition 
can be used to show, if the necessary condition of at least four correct is not 
met, that probably no one of the coofbinatlons has been mastered. Furtfaemore 
the sufficient condition operational definition can be used to show if the suf- 
ficient condition definition of at least five right has been met, then at least 
one of the conhinations has probably been mastered. Thus the test results have 
a verbal interpretation, but the test is not serving, in these sufficient con- 
dition instances, as a vehicle of Interpretation of particular principles or 
coohinatlons thereof. 

These operational interpretations r^resent a new approach to the relation 
between empirical data and the concept of masteiy. We would to see it tried 
and tested in other areas, and are using it because we feel it has promise. 
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C. RELIABILiaY 

Because of the principle and content conponents of the tests, it did not 
seem appropriate to confute a split-half reliability estimate.* dhere just 
vas no way to divide the tests into two e(pial halves. So we are reporting a 
test-retest reliability estimate based i^on the groups that did not receive 
logic instruction, the LRDT-l's and the LNBT-2's. They are lusped together for 
Ihese purposes. The administrations of the test were about ten weeks apart in 
the spring of 1964. 

These estimates are reported in T?ables IV-3 and IV-4 by separate grades 
for total score, conponent scores, and item group scores. Accompanying these 
estimates are the means and standard deviations on the pre-test for each score 
on whidbi a test-retest reliabilily estimate is presented. 

We had espected to find that the reliabilities would be lower and errors higher 
Tdien the mean scores were near their extrones (e.g., an item group score near 0 or 

near 6). Jhat is why we report the means and standard deviations in: these 
tables • 

However, a visual inspection of the reliability estimates suggests that 
they are relatively independent of the difficulty of the item groips. This 
ispression is sipported by the tables of standard errors of the item group 
scores (Tables IV-5 and IV-6). The standard errors hover around one, even though 
the difficulties of the item groups vary considerably. 

In order to make a rough check on the relative size of the standard errors, 
we divided them into two groips and conputed the mean standard error for each 
grcnp. One group consisted of those for idiich the mean score on the item group 
was wilhin 1.5 points of 4, that is, between 5-5 and 2.5. The other grcnp» con- 
sisted of the rest, that is those for which the mean scores were distant from 
our mid.*cutting point. Bor conditional reasoning these mean standard errors were 




* We prefer to speak of a reliability estimate, rather than a reliability, 
because we are securing only estimates of the actual reliabilities. 



* Using Fisher’ 





TABLE IV-3« Test-Retest Reliability Estimates on the Conditional Reasoning Test 

• Grade 05 N-76 Grade 07 N*75 Grade 09 N*6U Grade 11 N-51 All Qrades 



* Using Usher' 



IV-21 



a 



O 

ERIC 

MMliffilffTIILiU 



H H 



P H 



I^HOVOOO—Jc^vi 4ru) 



3 § S! ^ I I 



B 

et 






» » » 



0\O\0\O\O\O\0\0N0\0NON0\ 



H H ^ 

10 lO 00 



^lOfo foroHcocoroHLo-p* 

5^ • , ••••••••• 

ON-^ •P*VOU)VOO\>JIV/l-J ONUI 



*•— 5 ».* *,!„• • • • • • • 

•P^ONVI-^ CD — J 0\ vn o\-4 •P'OO 



•P* <:* vn 

• • • 

>Ji VO vn 



W H -J 

• • • 

•P* 0\ 



» 

i 






U) 



H 

vn 

o\ 





■P- U> 
IV> 




vn 


vn 

H 


vn 

03 


s 


P 

vn 




4=^ 

LO 


S 


0 

vn 

fo 


0 

P 


.80 


0 

00 

CO 


*1 1 


1 oa 

1 • 


o> ro 

• • 


LO 

m 


ro 

• 


lO 


fr 


p 


lO 


IV) 


p 


vn 


vn 


vn 




vn 

03 


Mean 


1 


4r ON 


p- 


ON 




p* 


b 


h\ 


vn 


b 


0 

03 


0 

vn 


0 

vn 


0 

P 


0 

03 


1 

1 • 


H H 

• • 


• 


H 

• 


H 


H 


H 


H 


H 


h* 


H 


fV> 


H 


-4 


£• 


D) 1 


I ^ 


vn 4r 


VI 


-*4 






H 


# 

P 


b> 


0 

03 


0 

H 


0 

vn 


0 


0 

H 


0 

VO 


u 1 


1 • 
% 


S’ g 


'ST 




Vn 

VO 


P* 

4?- 




CO 

VO 


;3 


ON 

VO 


R 


0 


0 

o\ 


0 

00 

vn 


s 


>4 1 


1 


CO 10 
• • 


LO 

• 


LO 

• 


lO 

A 




P 


IV) 


lO 


P 


vn 


ON 


vn 




vn 

P 




1 ^ 


4=' 00 


lO 


o 


IV> 


P- 


H 


00 


V3 


b 


0 


b 


0 

CO 


0 

00 


0 

00 


O 1 

B 1 


1 

1 m 


H I-* 

• • 


H 

0 


H 

• 


H 


H 


H 


H 


H 


H 




lO 


H 


00 


H 

-4 


09 1 


1 4T 


“-4 0\ 


ON 


00 


->4 


P 


b 


0 

p 


o\ 


0 

p 


0 

H 


0 

00 


0 

VO 


0 

03 


0 

VO 


tB 1 


1 ^ 
1 ^ 


S S 


CO 

00 


vn 

ON 


£ 


P 

VO 


03 

03 




ON 

lO 


vn 

P 


s 


0 

vn 

03 




0 

ON 

CO 


g 


*1 1 


1 •*=" 


•P* CO 

• • 


03 

• 


P- 

A 


CO 


vn 


p 


03 


P 


vn 


vn 


00 


ON 


CO 

00 


•-4 

M 




1 ^ 


VO vn 


NO 


IV) 




W 


•b 


Cn 


0 

O 


b 


0 

--4 


0 

03 


0 

VO 


0 

ro 


0 

P 


0 1 

B 1 


h* 

\ • 


H H 

• • 


H 

• 


M 

0 


H 

A 


H 


O 




H 


o 


O 


f» 


H 


vn 


H 

ro 


09 1 


lO 


H 4?* 


O) 


P- 


-*4 


O 


VO 


oa 


0 

-4 


VD 


0 


0 

ro 


0 

VO 


0 

H 


0 

o 


a 1 


1 m 

o\ 


vn fir 
lO H 




CO 


S 




03 

03 


p 

CO 


Si 

00 


iS- 


S 


p 


0 




g 


H 1 


• 


4S* CO 

• A 


CO 

• 


4=- 

0 


03 

A 


\n 

A 


p 


CO 


p 


V31 


vn 


->4 




CO 






-p- 


P* H 


00 


03 


00 


H 


vn 


VD 


# 

p 


0 

H 


0 

-4 


0 


0 

O 


0 

VO 


0 

o 


s 


A 


H 4-* 
• « 


H 

» 


K 

0 


H 

A 


H 


H 


H 


H 


H 


O 


l\> 


H 


-4 


H 

ON 


CO 1 


4r 


vn -4 


ON 






b 


b 


U) 


0 

-4 


b 


0 

00 


0 

--4 


0 


0 

P 


0 

o 


U 1 


g 


>2 )S 


£ 


P“ 

vn 


S % 




s 




ON 

vn 








0 

00 

vn 


k 


H 1 ' 







A O 



I 
0 ^ 



D1 

O 

O 

*1 



o o .. 

HQ* 

A • 



0 

B 



09 

O 



j5T js^ Sit ^VS'^vnwvji ov v/i o\ 

H OVON-4 rOC0fO«tV>'« ^ & 



o\ ^ -S 
U) o ^ 



00 
U) > 



s 



0 

s* 

A 

o 

45- 

tn 

i 5 



o 

a> 

s- 



a 

N 

00 



9 

0 

s- 

g 



I 



9 

0» 

§• 

H 

O 



f 

vn 

4^ 



f 

S' 

f 



ef 

I 

i? 

ff 

o 

d- 

s? 

H 

H* 

S’ 

H* 

H 



M 

0 

ef 



cfr 

A 

0 

O 

B 

$ 



0 

ID 

0 

s 

0 

0 

s 

H* 

s 

0 

ct 



S’ 

0 



IV-22 



TABLE IV- 5 . Standard Errors of Item Group Scores - Conditional Reasoning 



Item 

Group 


H * 76 
Grade 05 


H - 75 

Grade 07 


H - 64 

Grade 09 


H - 51 
Grade 11 


1 


IjQSi 


M 




1.03 


2 


.92 


1.15 


1.12 


1.08 


3 


.84 


1.14 


.92 


1.04 


k 


hSl 


1.28 


l2§ 


1.16 


5 


l.CBL 


1.04 


1.00 




6 


1.03 


1.24 


1.34 


1.12 


7 


.88 


1.34 


1.05 


_ 1.12 


8 


1.06 








9 




z25l 


J4 


JO 


10 




1.15 




1.27 


11 




3^25 




1.02 


12 


.85 


.94 


.93 


.98 



Rote: If the staBdard error is underlined^ the mean score on this item groim is 
vithin 1,5 points of 1|-; that is, between 2.5 and 5.5 
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SABUB IV-6. Standard Errors of Item Group Scores - Class Beasoning 



Item 

Group 


N « 71 
Grade 04 


H - 78 
Grade 06 


H * 76 
(hrade 08 


N * 54 

Grade 10 


H « 50 

Grade 12 


1 


1.2$ 


1.37 


1.92 


1.37 


1.40 


2 


1.14 


.64 


.80 


.$2 


J8 






mmmmm 


^ ■ 






3 


1.06 


.72 






.J1 


4 


1.19 


1.09 


.87 




.74 




mmmmmmm 


mmmmmmm 


m^^mm 






5 


1.08 


.92 




.71 






mmmmmmm 








6 


1.10 


1.0$ 


1.00 


.$3 


J9 












7 


1.19 


1.15 


1.23 


1.08 


1.25 


8 


1.18 


1.02 


1.19 


1.11 


1.26 


9 


1.20 


1.07 


1.26 




1.16 


10 


1.24 


1.20 


1.34 


1.08 


1.20 


11 


1.20 


I.l6 


1.32 


.76 


1.05 




mtmmmmmm 


m^mmmm 


' ' 




12 


1.1$ 


.97 


1.1$ 


.96 


.91 



Bote: If ‘ttie standard error Is underlined^ the mean score on this item group is 
within 1«5 points; that is, between 2.^ and 
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practically identical, 1.01 and 1.03 respectively. For class seasoning the 
mean standard errors were 1.05 and 1.32 respectively, giving a difference in 
the expected direction. But this is still insufficient to warrant the claim 
that there is an appreciable decrease in error around the crucial cutting 
points. 

2hus we were unable to find grounds to siqpport our es^ectation that the 
item groups would be more sensitive around the mid-range than at the extremes. 

As is esqpected, the reliability estimates for the total scores are the 
largest, running from a low of .65 on the conditional reasoning test for seventh 
grade to a high of .88 on the class reasoning test for sixth graders. Corre- 
lations on the class reasoning test tend to run slightly higher than on the 
conditional reasoning test, ttie mean total score correlation on the conditional 
reasoning test being .75 and on "the class reasoning test .83. 

Oie component reliability estimates are not so high as those for the total 
scores, presumably because of the fewer nuniber of items. Bie concrete familiar 
coaponents each consist of ii8 items altogether, the reliability estimates 
running from .60 on the conditional reasoning test for fifth graders to .85 
on the class reasoning test for sixth and twelfth graders — wi'Qi a mean of 
.65 for conditional reckoning and .79 for class reasoning. 

Hie symbolic conqponents, each consisting of twelve items, had correlations 
running from .27 for grade ei^t on the class reasoning test to .70 for grade 
ten on the same test. Hie mean correlations are *53 for conditional reasonii^ 
and .50 for class reasoning. 

On the suggestive component estimates of reliabilities ranged from •hO 
cm the conditional reasoning test for seventii graders to .73 on ‘ttie class 
reasoning test for twelfth graders. Hie means are .55 on conditional reasoning 
and .63 on class reasoning. 

Hie item groi^ test-retest correlations ranged from .26 for Item #L0 
of the class reasoning test st grade level six to .77 for Item (kou^ #L tor grade 
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twelve on the seoaie test. !Ehe mean item groigp correietlon for the conditional 
reasoning test is .52 and .50 for the class reasoning test* 

Since these item groi^ reliability estimates are based upon only six items 
apiece and are fbr scores to be used with groups rather than individuals^ tiity 
are encouraging even thou£^ they average around *5* Ihe total score reliabilities 
are of course more satisfactory^ but have the disadvantage of representing a 
cooposite score ^ rather than a fairly pure score* 

D* VAUDITT 

Several approaches to the validi*^ of the tests suggest themselves: 

Exa m in ing the items and liie procedures used to develop them to see if these 
items do represent the subject matter that they are sipposed to represent; 
asking outside experts to Judge whether in their opinion the test does test for 
^hat it is s\pposed to test for; detezmining the test's correlaticms with 
familiar measures and seeing if ‘Uiese relationships make sense; *»Tiiinining the 
internal features that empirical investigation shows the test to possess; seeing 
how much sense one can make out of the investigations ihich depend ipon the^^^®* 
test; and seeing the extent to uhich the test correlates with some established 
valid measure of ihatever it is that the test is supposed to measure* In this 
section we ihall report on all but the last of these epproaches to the determi- 
nation of validity* The last approach^ which sometimes ippears as concurrent 
validity, and scnetliaes as predictive validity, we shall not use, because there 
is no estsiblished outside criterion for measuring what we want to measure* 

!• Cbntent Yalidi'ter * 

Part of our atgosent for (X)ntent validity rests iqpon the procedures which we 
used to develop the test* We made a careful stu^y of the field of logic, and 
examined different kinda of qpecifie examplea of logical reaacsiing In evezydiy 
life: nawipapar editorlala, U*8* Svpreme Ocurt opinions in st^port of dacisiona, 
and an auto machaniet handbook* We found no caaea of cdaas or csonditional 

^ reasoning ihiefa were not eovared by our prlnciplea*. The porlneiples, aa was 
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pointed out in Chapter II/ are'^haaic and couprehenaive. 

Furtheznore ve engaged in continuous consultation with members of the 
Cornell Riilosophy Department idio are interested in logic. Professor Keith 
Donnellan/ idio has the major responsibility in the Philosophy Department for 
knowledge of logic among graduate students/ has examined and taken the tests/ 
and Judged them to be valid. 

Lastly the content of the items together vith the instructions is evidence 
of the test's content validity. Each item calls for an answer to the question 
which is the central question in logic: Does this statement foUov necessarily? 
And the answers depend \;gpon ihether one has the right answer to that question in 
each case. Furthermore the correct answers to the items are Justified by the 
principles. Ihere is an obvious relation between the items and the principles/ 
as can be seen by an inspection of the items. Ihe relationship goes both ways. 
Sot only doihe principles imnly the right answers to the items/ but generally 
speaking/ getting five or six of an item group ric^t loosely iig>lies a knowledge 
of the principles. Admittedly ‘fois last claim is not oncdiat can be proven; it 
is one that we rest upon the intelligent Judgment of informed interested people. 
2. Construct Validity . 

In looking at the construct validity of these testS/ we are looking at 
the degree to which they make sense in their internal and external relationships. 
!Dii8 makes our concern very broad/ broad enough to include concern with.'content 
validity as well. But since that has already been discussed/ we shall limit 
the present discussion to the other elements of construct validity. 

a. Oorrelntions with Familiar Measures . Because knowledge of logic is an 
intelleetual trait/ we e^qpected to find a substantial correlation between logic 
test scores and IQ scores. Furthermore it is partly a verbal intellectual trait 
so we expected to find at least some relationship between logic test scores and 
socio-*econcBie status (SBS). Fresumsbiy knowledge of logic is something that 

o 

ERIC 



IV-27 



increases with age (Burt, 1919; Piaget, 1950, 1958# 1959; Hill, 1961) - \mtil 

/ 

maturily anyway •> so we expected a substantial correlation with chronological 
age for our subjects uhen the varioius grades are gro\q>ed together. We did not 
esqpect to find any sizeable relationship between age and l^lc knowledge when 
figured at each grade level separately. 

Although we expected sex to be unrelated to logical ability, we were not 
sure. Burt (1919)# Miller (1955)# and Hill (1961) found no relationship, but 
Sweeney (1953) found that men did significantly better on logic tests, thouc^ 
vezbal Intelligence was controlled. 

We obtained correlations with these familiar variables that were basically 
in agreement with our esqpectations. 

In Table IV-7, which is based on pretests for LDT*s and IMDr-l*s combined, 
one can see, substantial correlations between TQ, grade held constant, and both 
tests. This is also the case for chronological age uhen grades are lumped 
together. The correlations with age by separate grade levels are gmnQ and 
generally negative, two of the nine being significant at the .05 level. This 
is insufficient proof of a small negative relationship, but should there be one, 
it would not be suxprislng. In fact it would be rather interesting, for it would 
suggest that in a given grade the more able logicians €u:e the younger ones. This 
in turn suggests the explanation that inherent mental ability is a more signifi- 
cant factor in logical abilily than it is in grade placement. And this in turn 
fits in with the substantial relationships that were obtained with IQ. These 
speculations bear farther investigation. 

There are generally saall positive correlations between S£S and logical 
kncsrledge, six of the nine correlations being significant at the .05 level. 

3he correlations between the tests and sex are and on either side of 
zero. Ihere does not seem to be any relationship. 
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ZABI£ IV- 7 . Correlations Between Total Scores on the Cornell Deduction Tests 
and Certain FamLUar Variables: Chronological Age> Soclo- 

Econcnic Status^ and Sex. 



Qrade 


H 


^^eparate parades 
Grades) Coniblned} 
CA CA 


IQ 


SE8 


SEX 


05 


53 


Conditional Reasoning 
-.09 




.24 


.00 


07 


^^7 


-.09 




.28 


.17 


09 


ko 


-.24 




.13 


.17 


11 


UQ 


ir\ 

0 

• 

1 




.12 


.09 


5,7,9, & 11 


188 


-.11 




.20 


.10 


6k 


kr 


Class Reasoning 


ill 




.00 


06 


58 


-.07 








08 


k9 


.68 

—.12 




-.10 


-.05 


10 


ko 


-.26 


.a6 


.26 


..09 


12 


kl 


.23 




.40 


-.22 


2^,6,8,10, & 12 


235 . 


-.12 




.26 


-.00 



Botes: 

1. These are based upon the pre-test scores of the IDT's and the IBST-l's. 

2. A correlation that is significant at the .0^ level is underlined. 

3 . Ibr SBB^ signs have been reversed for ease of interpretation. A 
positive correlation on this chart indicates that those with hi{^ 

BBS's did better than those with low SES's. 

k, Bdnerical assignment for sex gave boys a one and girls a two. Bence 
a positive correlation suggests that girls were better in that group. 

3 . Details about instruments used can be found in Chapter IH. 

6. The correlations for CA for grades cooibined are based only i^on those 
Miribm of the LDT's who were used for computing the mnltiple regression 
eqpiations discussed in Chapter VI. For conditional reasoning^ B • 6 k} 
for class reasoning^ N « 

7« OorrelBtions were averaged via Fisher's Z. 
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b. Item Analysis * Difficulty and discrimination Indices for each item 
at each grade level vere coaqputed. The difficulty index in this case is the 
percent of students taklxig IJie test vho ansvered the item correctly* A low 
in d ex signifies a difficult item* 

The discrimination index shows how successfully the item discriminates^ 
using in this case the total score on the test as a criterion* It is secured 
by separating out the top and bottom 2Tf> of a groiqp using the above criterion* 

The percent of sub;)ects in the bottom 275^ Vho correctly answer the item is 'sub- 
tracted trcm. the corresponding percent in the top 275^* In general the larger 

the result, the more discriminating is the item, unless the difficulty indices 
are near the extremes. 

TSbles A-1 and A-4 in the Appendix list the difficul-ty and discrimination 
indices for each item at each grade level for all subjects on the pre-test and 
in addition, for the LOT*s on the pre-test and the post-test* These indices 
are arranged according to item groiqps and the mean for each item gxo\xp is 
presented as well, giving an idea of the cooqparative difficulty and discriminating 
power of the item groups and perhaps the principles* The discussion in Chafers 
V and VI of the natural cultural development of logic knowledge and the capacity 
for logic knowledge will draw heavily iqpon these tables* Here we Shall 
only Ihe most obvicris comnents and present a few interesting means* 

Tables IV-8 and IV-9 in this chapter provide something of a BUDnazy of this 
detailed difficulty and discrimination information, by giving the on the 
pre-tests for each item group, component,* and total at each grade level. This 
suBSMiy, when it is ex a min ed from the x>oint of view of the development of under - 
standing of logic, is qyiite revealing, but that is the topic of the next chapter. 

let it be noted, however, that there is considerable variation in the dif- 
ficul'ty levels of the various item groiqps, with a range of l4.1 - 87.6 on the 
conditional reasoning test and 30*2 - 95*^ on the class reasoning test. These 



TV-30 



XABI£ IV-8. Mean Difficulty and Diacrimination Indices For Jhc Conditional Reasoning 
Testi Based Upon IVe-Test of UXT's, INDd’-l's, and lRDT-2*s Cooiblned. 



Mean Difficulty Indices Mean DLscrininatlon Indices 
CSrade 57911 57911 
N * 102 99 80 78 102 99 8o 78 



Item 


Gro^ 

1 


71.4 


7l».7 


77.3 


78.8 


37.0 


32.1 


18.9 


34.9 


2 


22.7 


27.4 


24.8 


35.3 


-17.9 


16.7 


5.3 


27.8 


3 


17.7 


26.8 


31.5 


35.7 


-13.0 


6.2 


3.8 


29.4 


k 


55.7 


68.7 


59.6 


65.0 


50.0 


33.9 


24.2 


25.4 


5 


56.T 


67.9 


66.3 


76.1 


37.0 


43.2 


24.2 


35.7 


6 


56.5 


66.2 


57.7 


65.3 


50.6 


30.8 


13.6 


14.3 


7 


l4.i 


24.1 


28.6 


lf3.2 


12.3 


9.3 


22.7 


53.2 


8 


68.6 


80.6 


77.9 


85.7 


47.5 


35.2 


31.8 


30.9 


9 


70.8 


78.3 


78.6 


87.6 


39.5 


33.3 


21.9 


23.0 


10 


54.7 


71.2 


68.8 


77.6 


36.4 


46.3 


39.4 


46.0 


11 


54.6 


66.0 


64.2 


86.8 


51.9 


30.2 


28.8 


23.0 


12 


26.3 


17.8 


19.4 


21.6 


6.2 


6.2 


3-0 


5.6 


CP 


48.9 


55.4 


55.2 


61.8 


23.2 


26.3 


19.4 


32.0 


sr 


48.1 


55.8 


53.4 


59.5 


29*0 


26.5 


21.2 


19.1 


su 


41.3 


53.4 


53.3 


59.9 


34.3 


26.5 


22.3 


31.8 


Mean over 


all items 


^T.5 


55.8 


54.6 


61.5 


28.1 


27.0 


19.8 


29.1 



Mean DisertoioBtion Index for All Qrades on Ibtal Test: 26.0 
Total H « 359 
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TABLE IV-9* Mean Difficulty and Discrimination Indices Eor Ihe Class Reasoning 
Test, Based Upon Pre-Test of LDT's, IMDT-l's, and LNDT-2'8 Ccanbined. 



Mean Difficulty Indices ll4ean ^scrimination Indices 



Grade 
N » 


4 

94 


6 

103 


8 

100 


10 

75 


12 

72 


4 

94 


6 

103 


8 

100 


10 

75 


12 

72 


Item 

Group 


1 


76.1 


90.6 


91.5 


93-4 


95.4 


53.3 


22.6 


21.0 


5.0 


10.0 


2 


55.7 


64.9 


67.7 


82.4 


82.7 


32.7 


27.4 


37.0 


15.0 


20.0 


3 


30.2 


42.9 


49.2 


66.5 


75.0 


24.0 


40.5 


39.5 


39.2 


45.0 


4 


43.4 


42.6 


47.7 


58.0 


66.7 


20.7 


23.8 


31.5 


25.8 


34.2 


5 


64.7 


70.7 


66.3 


80.0 


79.9 


30.0 


i 4.3 


19.7 


10.8 


22.5 


6 


61.7 


76.9 


79.0 


86.5 


87.1 


40.0 


26.8 


38.3 


15.8 


25.8 


7 


33.9 


38.0 


36.5 


58.7 


63.0 


6.7 


44.7 


37.7 


31.7 


46.7 


8 


37.1 


te.if 


51.7 


67.6 


71.6 


28.0 


41.7 


43.2 


38.3 


45.8 


9 


51.1 


56.3 


58.5 


66.7 


58.1 


41.5 


20.8 


32.7 


17.5 


26.7 


10 


43.6 


1)8.2 


52.5 


59.3 


55.3 


30.0 


31.6 


39-5 


20.8 


20.8 


11 


52.1 


62.3 


66.3 


79.3 


78.3 


38.7 


27.4 


45.7 


19.2 


38.3 


12 


41.7 




53.2 


61.1 


59.7 


23.3 


26.8 


42.6 


27.5 


41.7 


CP 


54.5 


64.8 


67.2 


78.5 


77.3 


32.3 


28.9 


32.5 


19.2 


29.0 


SI 


43.1 


44.8 


46.4 


55.0 


61.7 


22.3 


20.5 


25.0 


24.6 


28.3 


SO 


4o.l 


47.2 


56.2 


67.3 


67.0 


33.1 


40.0 


48.2 


28.3 


44.6 


Mean for 
all 


items 


lt9-3 


56.6 


60.0 


71.6 


72.7 


30.7 


29.0 


35.7 


22.2 


31.5 



Mean Discrimination Index for All Grades on Total Test: 29.6. 
Ototal N s iM. 
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ranges extend across grades^ but one can see that certain item groins are more 
difficult than others. Hhis is in conformity with the view that certain prin- 
ciples of logic are more difficult than others and are learned later. It is in 
conflict with Hie view that one kind of logic is learned at one stage in life and 
another kind learned at a later stage. It appears that parts of one kind are 
learned before parts of the other and that pairts of ttie other are learned before 
parts of the one. 

The level of the mean difficulty indices (ranges: 47*5 - 61.5 for conditional 
reasoning and for class reasoning) suggests -ttiat neither test^ 

Tdien administered for purposes of securing a total score^ is too difficult for 
grades 4-12. 

Our purpose in develpping this test^ however^ was not primarily liiat of 
securing a total score^ but rather to enable us to determine idiether a certain 
princii>le of logic has been mastered at a given level. Hence we do not approach 
•Hie test with a preconceived idea of idiat Ihe mean difficulty levels of the 
item groins should be. Instead we in a way seek to find out what the dif- 

ficul'ty levels are in order to find out what is mastered and what is not. 

!Ehe discrimination index pattern^ in conjunction with the difficulty index 
pattern^ is quite interesting from the point of view of developnent^ but as we 
said> that is the topic of the next chapter. !lhe following observations are 
relevant here: 

1. !Ehe only item group l^at consistently fails to discriminate at all 
levels of administration is conditional Item Groiq> jj^l2. This may be be- 
cause of its great difficulty (mean always below 30^)* With instruction in 
logic incidentally^ as will be seen in Chapter VL, the item group becomes 
considerably easier in grade eleven with a mean difficulty of 62 ^. 




2. Other cases of low mean discrimination indices are found at either 
the early grades or the advanced grades^ the former apparently because the item 
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grovp is difficult at that levels and the latter because the Item group is quite 
easy at that level. Cases of the former are conditional numbers 2 , 3> and class 
number 7; cases of the latter are class numbers 1 and 2. 

3* All low discrimination indices are thus accounted for except the fairly 
lov ones in grades nine (13*6) and eleven (1^.3) for Item Group ^6 In conditional 
reasoning. We do not have an e 3 q>lanation for these fairly lov indices^ nor for 
the fact that they are so much lover than the index for this item group in grade 
five (50.6). Hovever, they are not embarrassingly lov; they are just fairly lov. 

With this one exception, then, all lov discrimination indices are accounted 
for by the purpose of the tests, vhich vas to ascertain idiether members of a set 
list of basic principles vere mastered at various levels. Unsurprisingly tiiere 
are some \4iidi at a given level are either easy enou^ or difficult enou^ to 
result in lov discrimination indices. 

Given the purpose of these tests, the discrirdnation and difficulty index 
patterns are satisfactory. 

c. Making Sense in the Context of the Study . A third type of argument for 
construct validi'ty tries to shov that the results of the use of a particular 
instrument make sense. Ihus in a vay the argument for validi'ty of these instru- 
ments depends in part on the intelligibility of the es^rimental findings. Hence 
the next two chapters, tdiich present the ejgperimental findings in the areas of 
natural-cultural development and readiness development, are isgilicitly discussions 
of the construct validity of the tests. Roughly speaking the more intelligible 
the results, the more valid the test is shown to be. 

E. SUGOBSXED fURSHER IffiVELORffiRT 

Several ideas for further development of the Cornell Deduction Test Series 
(or of some other deduction test series) have occurred to us before and ahile 
appraising these two tests: 
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1* Tests of other kinds of deduction should be developed. Ordinal reasoning 
and other kinds of sentence reasoning (alternation, disjunction, conjunction, 
and combinations of these vlth each other and conditional reasoning) ^ould be 
developed first, because the principles for these t^ypes are fairly veil developed* 
Tests for deontlc, alethlc, epistemic and other fonns of logic must avait the 
preparation of a set of principles for each of these types. Hence the second 
recomnendatlon . 

2. Principles of lypes of logic oHier than class, sentence, and ordinal 
ihould be fcxnnulated. This is a very difficult task. 

3* Satisfactory methods i^ould be developed for using the two existing 
tests with lover elementary students (grades 1-3)* One possible adjustment is 
to Ehorten the tests. Each test is designed so that the second half (items 43-78) 
can be dropped off without destroying the item grotp structure. Instead six 
of title more difficult item groups are simply omitted* Tables IV-1 and IV-2 
show which groiqps would thus be omitted. 

IXzring tiie pilot year of the project, we developed what seemed to be promising 
procedures for administering early editions of deduction tests to lower elemen- 
tary studoits. For second and third graders items were sliqdy read alo ud ihile 
they followed along and marked answers directly on the test booklets* Testing 
time was broken up into separate i>erlods of twen'^ or thirty minutes ipiece. 

Two people handled classes of twenty to twenty-five stud^ts in this manner. 

3?br first graders five students at a time were tested for i>eriods of twenty 
minutes, the first of these periods being devoted simply to instructions 
practice problems. A separate answer ^eet was used (see Appendix) and the 
qdestions were read to the children. One person handled the testing but was 
very busy. 

o 

ERIC 



IV-35 



On the hasls of this experience ve feel that group logic testing vith 
this sort of test is possible at the lover elementary level. Incidentally Hill 
(1961) tested lover elementary students in logic ^ but did not face the problem^ 
uhlch> as ve Indicated early in this capter,« should be faced, of getting svibjeots 
to Judge vhether an argument is invalid or not, uhen the proposed conclusion does 
not contradict the preoises. 

4 . Scores on these tests should be correlated vith other measures of logic 
knovledge, such as grades in an elementary logic course and scores on other 
logic tests. It vould be particxilarly interesting to see the relationship betveen 
'Uiese tests and an open-ended logic test in nhich subjects are asked to supply 
the conclusion themselves, the intent being to see the extent to idiidi a multiple 
dioice test like these can be used as evidence of ability to deduce conclusions, 
given only the premises. Ihus one could see the extent to iftiich these tests 
fall to test for deductive creativity (if they fail at all). 

5* Ihese tests could be expanded so as to include more items in each item 
groiqi, thus achieving a more reliable measure of each principle, but of course 
sacrificing either coopr^ensiveness or compactness. Such a sacrifice vill be 
necessary if one vants to use the test to measure and predict individuals' 
scores, as can be seen from the item group reliabilily estimates. 

6. !Die tests could also be expanded to Include a negation component. Bin 
found that negation vas an isportant source of difficulty in logic for lover 
elementary students (1961, p. 66). In a vay the conditional reasoning test 
has a negation component built in by means of the CF 4 items. Ihese had mean 
difficulties vblch vere lover at each grade level than the totel mean dif- 
ficulties and the mean difficulties for each of the cooponents. CF^ mean dif- 
ficulties at grades 1 , 9 , and U are respectively 38 . 4 , 43 . 8 , 43.3, and 30.O 
as compared vith total mean difficulty indices of 47.3, 33.8, and 34 . 6 , and 61.3. 
Btaice negation appears to be an important source of difficulty. 

ERIC 
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7* Iftich correlational work could be done in an atten^pt to see relation- 
ahips between various personality and other variables and the logic oo^ooents. 
One sdififc wonder idiether an authoritarian personality, for example, is relatively 
poorer on the suggestive component tiian is some contrasting personality ^ 9 pa* 

F. CBAIIEH smARf 

Biis ch^ter commenced with a description of the basic structure of the 
tests by presenting the three components (concrete familiar, synibolic, and 
suggestive showing the distribution of these components within each groig> of 
six items; shoving the relationship between the item groig>s and the principles 
of logic idiich were presented in Chapter H; and eaqplaining the item arrangement 
and format. Next operational definitions of 'mastery of X principle' were 
developed. Boujihay yaking these operational definitions specified getting 
correct at least five out of an item groiqp as a sufficient condition for mastery 
and getting at least four as a necessazy condition for mastery. 

Next came the presentation of reliability estimates, \hich consisted of 
test-retest correlations, ^lit-half correlations were not used, because it was 
not possible to ^llt the tests into.eqjulvalent halves. These correlations were 
reported for total score, component scores, and item groip scores at each grade 
level that took each of the two tests. The mean reliability estimate on "The 
Cornell Class Reasoning Test" is . 83 , and is .75 on "Ohe Cornell Conditional 
Reasoning Test". The mean correlations for the components and item gzoups are 
lower, but sufficient in our judgment for use of the tests with groins. 

Discussions of content and construct validity came next, with the latter con- 
sistlng of three parts: correlations with well known variables, item analyses, 
and making sense out of the eaq^erlmental results. In effect, this last topic is 
Ihe prcblem of the next two chapters on the estperimental results. 

Finally a nuaber of suggestions for further development of logic tests were 

made* 
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Cbopixr V* She IfeturalvCulturol Oevclopnent 
of I&xndedge of Logic 

Bie developtient of knowledge of logic under contenpoxy conditions is the 
topic of this chapter. He shall not attempt to make any estimation of *010 
degree to idiieh development is attributable to nature as opposed to nurture* 
We dhall sinply try to describe idiot we have found in this group of 8O3 
i9per lew York State students idiose ages range from about j to I8, and idiose 
mean IQ is rouQ^ily ll 4 * We do not doubt for a moment that environment has 
played a significant role in the development of their logical capacities* 

One cannot^ for example^ be sure that there has been no previous con- 
scious effort to teach them logic* On the contrary it is presumable tiiat 
most students have received at least some informal instruction from tiieir 
parents^ their teachers, or their peers* But we do know that our staff did 
not teach logic to these students prior to the test administration tdiich 
this diapter considers* In the next chapter we will consider what later 
happened to those students to ihom we did try to teach logic* 

A. TBE UTERAIUBE 

Jean Piaget is the best known and most prolific contributor to the 
literature on the development of knowledge of logic; First we shall examine 
his characterization of the foimal operational stage, which he holds runs 
from ages 11-12 on* Bien we ^all pose questions which his views suggest 
and on idiich the pre-test administration of the Cornell Deduction Ibsts 
throws some ll^t* Other studies will then be considered for their bearing 
on these questions* 

!• Piaget *s Formal Operations * 

A standard claim made by Piaget is that the concrete operati<mal period 
of thought runs ftom ages 7-8 to 11-12, at which time it is followed by the 
foxnal operational period, the apex in the development of thou^t (e*g*. 
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Inhelder and Piaget, 1958, p. 1*). in the approaching diacussion ve shall 
oqihaaise formal operational thought, but shall draw upon his notion of 
concrete operational thou£^t for purposes of contrast. 

Pia Real Versus the Possible . 

According to John ilavell in Pie PevelopBiental Psychology of Jean Piaget. 
”ahc moat important general property of formal operational thou^t, the one 
from lAiich Piaget derives all others. .., concerns the real versus the pos» 
Bible.” (1963, p. 20*i-). Apparently it is the ability to deal with the pos- 
sible, rather than just the real, that supposedly is uniquely found in the 
formal operational period. We have found in Piaget three, perhaps four, 

different basic features of this cognitive ability to deal with the possible, 
instead of just the real: 

1) Pie first is the ability to judge an argument on the basis of its 
®® opposed to judging it on the basis of one*s belief about the 
trutt of the conclusion. We shall call this the ‘truth- validity character- 
istic'. It is manifested in several ways; by reasoning from assunptions 
tdiich are known to be false, by reasoning from assunptions ^ose truth 

status is not known, and by reasoning and concluding without regard to the 
truth status of the conclusion. 



According to Piaget; 






fhr« reasoning he^en the years of 7-8 and U-12 wiU there- 

fonuBl reasoning vill not yet be'posslble. 
reasoning connects assungttions - jaxjposltions, that is, 
to Milch one does not necesssrlly believe, but uhlch one adnlts in 
order to see Miat consequences they 11111 lead to (1,28, pp. 850-51). 



^ «fer to this wrk by 

to*tof *•>« 4i»trlbution of authorship reporW 
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More specifically Piaget says the following things: The formal operational 
thinker is able to reason "on the basis of assun;>tione lAiich have no neces- 
sary relation to reality or to the subject’s beliefs... He relies on the 
necessary validity of an inference as opposed to agreement of the conclu- 
sions with ejqperience" (1950, p. l 48 ). "Oto reason formally is to take one’s 
premises as sin5)ly given, without enquiring whether they are well founded or 
not...; belief in the conclusion will be motivated solely by the form of the 
deduction * (1928, p. 25I). IXrring the concrete operational period, on the 
other hand, "the child cannot reason from premises without believing in them. 
Or even if he reasons in5>licitly from assun?)tion8 which he makes on his own, 
he cannot do so from those which are proposed to him" (1928, p. 252). 

Flavell says, "In general, Piaget finds that contrary-to-fact ’what if’ 
siQ)po8itions...tend to be foreign to the thought of middle childhood" 

(1963^ p. 208). ilavell is here en5>hasizing a striking part of the truth- 

validity characteristic, that of working from 8S8un5>tions which one actually 
disbelieves . 

The suggestive cos^nent of the Cornell Deduction Tests is cdmed at this 
truth-validity characteristic. In each item in this component the validity 
status of the argument is different from the truth status of the conclusion, 
and often the premises that are offered are obviously false. Tb identify 
these items in the tests, idiich may be found in the Appendix, see Tables IV-1 
and IV-2 in Chapter IV for the item nunibers assigned to this coo^nent. 

2) A second feature of the ability to deal with the possible is the 
abUity to operate in the ftramework of all the possible coaibinations in a 
given situation. Since this characteristic was discussed at some length in 
Chapter H, one quotation should suffice here: 
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* nece.awu»'; 

nrt belief that tte conclualon Is true', llie latter la auegeated lyhla 
choice of words, "belief in the conclusion". ^ 



If w accept the task of describing the structures uhich actually 
^erate in the subject *s minds, we have to use the criteria furnished 
^ toe combinatorial system in distinguishing between concrete ... and 
formal ... operations (1958, p. 280). 



Chapter II attempts to clarify Piaget »s notion of a conibinatorial system. 

Presumably toe Cornell Deduction Tests do not test for this characteris- 
tic of toe ability to deal with, toe possible. If, however, doing conditional 
reasoning, which implies doing propositional reasoning, is alleged to inply 
working within a conibinatorial system (and, as we pointed out in Chapter H, 
there is some suggestion to this effect), then toe entire conditional reason- 
ing test is a test of this combinatorial characteristic. We do not think 
that Piaget would want to allow this, so, until told otherwise, we shall 

maintain toe presumption that toe Cornell Deduction Tests do not test for 
this characteristic. 



3 ) A third feature, as Piaget views toe real-possible distinction, is 

the ability to control variables in (presumably) an empirical investigation: 

©JO discoveries found at toe beginning of toe formal level are (l) 
that factors can be separated out by neutralization as well as by 
exclusion and (2) that a factor can be eliminated not only for toe 
pu^ose of analyzing ita ovn role but, even more liqportant, wlfji 
a view toward analyzing the variations of associated factor b. ( nsf j f>- 3.1 

Bie Cornell Deduction Tests do not test for this chsracterlstlc, unless It Is 

alleged that this characteristic and conditional reasoning ability are logi- 

cally Interdependent. Because Piaget seems to relate aU of the features of 

the foiBSl stsge to each other in a manner that is never clearly specified, 

there is some ground for thinking that Piaget mW>t allege the above logical 

interdependence. But again, until told otherwise we shell assume that Piaget 

would not consider the Cornell Deduction Tests to be messures of abUity to 
control varitoles. 

h) Whether the fourth feature ahould be considered part of toe resl- 
poaaible distinction or a separate featux^ of toe 



concrete formal distinction, 
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l8 problematic. This fourth feature is the ability to do propositional logic, 
instead of just class logic. According to Plavell, as quoted above, the real- 
possible distinction is "the one fr.:an uhich Piaget derives all ottiers", so 
presumably the class-propositional distinction should be derived from it as 
veil. Furthermore, as we Indicated in Chapter II, there is reason to believe 
that Piaget wants to connect ability to do propositional reasoning with the 
ability to deal with the possible instead of Just the real. 

But, as we also indicated in Chapter II, to hold this view about 
propositional logic is to hold a different notion of propositional logic 
than the standard one and than the one which is operation in this project. 

The most charitable interpretation of Piaget's views is that propositional 
reasoning is definitionally independent of ability to deal with the possible. 
We shall adopt this interpretation.* 

In any case Piaget maintains that propositional reasoning (and thus 
sentence and conditional reasoning) is not possible until age 11-12. 

"The child at the concrete level (stage II: from 7-8 to 11-12 years) cannot 
yet handle... propositional logic...." (1958, p. l). 

The conditional reasoning on "The Cornell Conditional Reasoning Ttest" 
corresponds to much but not all of Piaget's propositional logic. Omitted, 
because of time and space pressures, are alternation, disjunction, and con- 
junction. Included are conditionals. Which, roughly speaking, are statenentf^ 
containing the word 'if and its synonyms. That Piaget finds conditionals 
to be a central part of his propositional logic is seen in the following 
quote which, in referring to implications between propositions, is referring 
to conditionals: 

*Biren thoujh we list this propositional-class distinction along with the 
others. 
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Pbnnal operations^ therefore, consist essentially of 'inplications' 
(in the narrow sense of the word) and * contradictions' established 
between propositions lAidi themselves e:q>ress classifications, 
seriations, etc. (1950, p. 1^9)* 

b. Kinds of Eormal Thought . 

Becently Piaget has introduced two stages in formal thou^t which he 
calls IIIA and IIIB, the former running from 11-12 years to 14-15 years and 
the latter from 14-15 years onward (1953, p* !)• He holds that it is not 
until IIIB that the child thinks in terms of necessity of relations (pre- 
sumably enqpirical relations) instead of constancy (1953, p. 11 ); and that 
the full grasp of the concept, all other things being equal, is attained 
( 1953 , p* 43 } • Neither of these features is a feature of formal logic and 
neither is tested for by l^e Cornell Deduction Tests. 

Interestingly Piaget does not suggest, so far as we can find, that any 
principles of conditional reasoning are attained later than others, nor that 
any is more difficult than another. Similarly he does not distinguish among 
principles of class reasoning, nor among principles of alternation, disjunc- 
tion, and conjunction. Instead he lun^s all of sentence reasoning together 
(under the title "propositional reasoning") and all of class reasoning 
together, saying that the latter can be done in the concrete operational 
stage but that the foxner cannot be done until the formal stage. Ihere 
seems in his work to be no differential treatment of either type of logic, 
in so far as developsient is concerned. He dc»es of course recognize different 
principles of reasoning, but for study of development and mastery, he lumps 
them together. 

c. Stages . 




Piaget talks as if there are stages in the Intellectual (including 
logical) developnent of youngsters. The claims about the concrete opera- 
tional period running trm 7-3 to 11-12, and the formal operational period 
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running from 11-12 onvard sound as if be does think in terms of stages. 

Naturally the distinction between the meaning of 'stages of growth' and 

* 

'continuous growth* is a difficult one to draw, so it is hard to put the 

question in a precise manner. And Piaget does not help very much, perhaps 

because his views are changing. In Judgment and Reasoning in the Child 

he speaks fairly e:qplicitly of distinct stages: 

Bie evolution of intelligence is therefore not... continuous, but 
rhythmical; it seems at times to go back ig)on itself, it is subject 
to waves, to interferences, and to 'periods of variable lengths* 

(1928, p. 215). 

On the other hand his introduction in Ifae Growth of Logical Thinking 
from Childhood to Adolescence of two subdivisions of the formal operational 
period, stages IIIA and IIIB, suggests on his part a belief in more continuity 
of development than is inplied by the above quotation. 

!Ihe data of the present study has bearing only on the age range 10-18, 
and thus should not be considered as evidence on the claim that there is a 
concrete operational stage. It is some evidence on the question of the 
existence of stages in knowledge of logic in adolescence. But whether Piaget 
ever actually meant to raise this question specifically is unclear, because 
the distinction between IIIA and IIXB is not a distinction between types of 
logical knowledge. 

Unfortunately the question of the existence of stages is basically an 
unclear question because there is lacking a criterion of how much of a 
leveling off is necessary for there to be a stage. Bie question is essen- 
tially a pragmatic question, since the answer depends on one's purposes. 

Wte interpret the question, "Are there itages?" as meaning, in effect, "Is 
there enough of a regular leveling off for a long enouf^ time for the 
leveling to be significant for one's purposes?" Thus it is quite inportant 
to specify the purposes. Out of some purposive context, the question is 

o 
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at least partly indeterminate. Perhaps that is there is so much dispute 
about Piaget's alleged stages. 

The concept^ stage of development > is a tricky one. We do not feel 
that Justice has been done it in the preceding paragraidis. Avaiting a 
good analysis of this concept ve shall liup along with the above intuitive 
notion of purposiveness. Perhaps this will do, given the current lack of 
thorou^ and detailed information. 

d. Questions Posed by Piaget's Work . 

The age range covered by the present study (roughly 10 to l8) corresponds 
approximately to that of Piaget's formal operational period (11-12 onward). 
Because his work on this period is so extensive and well-known, we presented 
his theoretical description in detail in order to show the taking-off point 
for the natural-cultural part of our study. Of the fo\ir basic features of 
the foimal operational period (possession of the truth-validity characteris- 
tic, ability to operate within the framework of a combinatorial system, 

®bility to control variables, and ability to do propositional logic), our 
findings are relevant to the first and fourth. 

These two features are the ones treated in the current study because 
they are the ones that are clearly related to ability to do deductive logic. 
Ihe other two are either peripheral or unrelated, depending on the inteipre- 
tation given them. 

What we have done is not to be regarded primarily as a test of Piaget's 
claims, but as an extension and refinement of them. By and large we find 
his claims to be a bit too vague and/or indeterminate for careful testing. 

His concepts and concerns did, however, provide us with ideas for the ques- 
tions \diich are listed below. Although^ as the reader will see, our answers 
to tiiese questions still leave much that is indeterminate, they are more 
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definite than Piaget's claims and hence are an extension and refinement of 
them. Of course there is a degree of testing of his claims as veil. 

Eor the genesis of the following six questions we are intellectually 
in debt to Piaget. Ihese questions were suggested by his work and strike 
us as '^eoretically interesting and practically important^ tram Ihe point 
of view of soeieone making decisions about the develoipiient and placement of 
materials in a currlculim. 

1. Is there actually a develppoent of logical abilily as Children grow 
older? 

2. Does this developnent (if there is any) come in stages? 

3- Is conditional logic mastered by age 11-12? 

U. Is class logic mastered by age 11-12? 

Is the 'bruth-validi'ty characteristic adbieved by age 11-12? 

6. Within each type of loglc> is there a development of one sort of 
thing before another and are some things more difficult than others at a 
given level? If so, \diat is ttie nature of this differential development? 

Of the above questions, we feel that the last is Ihe most interesting 
and the one toward ihich this study makes an original contributira. Bie 
first question which is about whether there is developaient, has an unsur- 
prisingly affirmative answer from the present study. Ihe seccmd question, 
once you are pest the problem of specifying the criteria for a stage, is 
though atill not ea^y to answer, very much dependent on what one regards a 
stage to be. Ihisv^prisingly the evidence of this study points toward an 
answer of "Partly" for Questions 3> and 5« But Questicm 6 is the one 
that brings forth specific refinements in gross statements about class logic, 
aantenee logic and the tnrth-validiiy characteristic. 




2. Other Studies 



Obis discussion is organized around the six questions Just asked. 

a. Is "ttiere a develoniaent of logical abili^ as children grov older? 

In addition to Piaget the following people, as a result of their researdi 
contend tiiat there is such a develppoent: Bonser (19IO), (thou^fh his tests are 
hardly logic tests), Burt (1919)1 Winch (1921), Moore (1929) and Hill (1961). 
Miller (1955), on the other hand, did not find development in aibility to 
recognize fallacies in grades 10, 11, and 12. However, many of Miller's 
faUacies are not fallacies of deductive logic and he worked over a span of 
only two years; so we are inclined to feel that the wei^^t of evidence ticm 
the literature is in support of the initially plausible view, that there is 
developnent of logical ability as children grow older. 

b. Does the deveLopnent come in stages? 

Out of 8oae purposive context, this question is partly indeten&lnate. 
Hence it is difficult to report others' results on the question. We can 
only indicate whether what they found struck them as being regular develop- 
ment a 

Moore (1929) believes that the development in knowledge of deductive 
logic that he found in children of ages 6-12 was regular (and hence not in 
stages). Burt (1919> P* 126) and Windi (1921, pp. I38, 209> 284) found 
regular improvement with grade. Hill (I9^i P* ^)i working with students 
of ages 6-8, found regular development in their knoidedge of logic. Since 
Miller (193$) found no developmeiit in ability to recognize fallacies in 
grades 10-32, his results are not inconsistent with the stage hypothesis. 

On the liiole, we feel that the reports of resesrdi do not support any stage 
hypothesis, particularly in view of the fact that we are unable to see 
su ppo rt for it even in the ea^erimental findings of Piaget himshlf . But be- 
cause of the context dependence of the qEuestion, one must not on this basis 
mdse s definite Judgment about the existence of stages. 
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c. Is conditional logic aastered "by age H«12? 

Considerable researdi has been done idiieh suggests (in conflict vith 
Piaget's claims) that children can do at least some conditional reasoning 
before 11 - 12 ; Bonser (1910), Burt (1919)# Winch ( 1921 ), Wbodcock (19^1, p. 
136), Hill (1961, p» 51)* But Hie question of idielher and to uhat degree it 
has been mastered by age 11-12 has not been investigated. Bov Piaget does 
not state that it is fully mastered by the age 11 - 12 , but he does not indi- 
cate the extent to idilch he thinks it is mastered after this age is attained. 
3he tvo earlier-mentioned characteristics of the distinctly betveen stage 
mA and IHB do not help, because they are conceited with empirical rather 
than logical matters. 

Tto our knovledge no pure conditional logic tests have been administered 
to adolescents and analyzed for the degree and kin d of knowledge cdiown. 

d. Is class logic mastered by age 11 - 12 ? 

Ihe references cited under the previous question also support the cyten- 
tlon that at least some class logic is mastered before 11 - 12 . And Piaget 
wuld agree vi'tti this, though one cannot be sure tdie’ttier he thinkg that all 
of the basic principles of class logic are mastered by the end of the cy- 
crete operational period. One mic^t think so, since class logic is a charac- 
teristic of this period, according to Piaget. However, an he says is that 
only class logic is used in this period (19^, p. l). He never specifically 
states the extent to whi(di he Ihinks it is mastered, so far as we can deter- 
mine. 

«• Is the truth-validi’^ characteristic achieved ty age 11 - 12 ? 

80 far as we can detezmine, Piaget is tiie only persy who has made 
claims about the attaizment of the trath-validi*^ characteristic befbre age 
11-12. A noiber of studies of this coopyent of logical ability are mentioned 

in Oiqpter IV, but they are all y older people. Since these studies gyer- 
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ally show that suggestive ax'guments vlth content are handled less ably than 
arguments vlth concrete familiar content^ the minimum ansver suggested by 
these studies to the giiestlon Is that the truth-valldl'ty characteristic is 
not fully achieved by age U-12» So far as ve can tell> Piaget does not 
conmit himself to a degree of attainment of the characteristic^ Just as he 
does not comnlt himself to a degree of attainment of propositional and class 
logic. 



f» Within each type of logic, is there a development of one sort of 
thing before another and are some things more difficult than others at a 
given level? If so idiat is the natxire of this differential developm<*T»t.? 

Ihere is not much evidence on this matter. Except for his attention to 
■Uie truth-validity characteristic^ Piaget seems to have ignored it. 

(1961) explicitly raised the question with reject to knovledge of different 
principles and found in ages 6 through 6 no pattern that she could discern 
(p» 57)* However, her test, it should be remembered, did not test for any 
fallacies. In class reasoning Wilkins (1928, p. 7?) found the ccxsponents to 
be in the following order of increasing difficulty for college students: 
concrete familiar, suggestive, symbolic, and unfamiliar. 

Burt (1919), as a result of his ej^rlence developing and administering 
his "Graded Seasoning Tests" held that the basic mechanisms of fontal rea- 
sonlng are all there by the mental age of 7, and that differences are re- 
sults of coBiplexity. 

All the elementary mechanisms essential to. formal reasoning are 
present before the child leaves the infants' department, i.e., 
by the mental age of seven, if not somewhat before. Development 
consists primarily in an increase in the extent and variety of 
the sUbJect-matter to which those mechanisms can be applied, and 
in an increase in the precision and elaboration with which those 
mechacisms can operate. The dlfflcul'ty of a test depends upon 
its conplexi'ty, that is in the main ipon four points: how 
many connections have to be made between one idea 
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and another only three> aa in the ordinary ayllogiam^ or four> 
or more? Hov many of these connections has he to supply himself? 

Bov closely are these connections to be knit together — in 
parallel^ in series^ or in s more or less intricate system? Hov 
far do they fall into the same categoiy of time/ space> nusiberi 
etc*^ or differ one from another? Other points^ vhit is the pre- 
cise nature of these connections — tenqporal^ spatial^ numerical/ 
causal^ etc. — and of their interconnections — hypothetical^ 
disjimctive, etc. — are of little importance. 

Burt's four aspects of complexi*^ mentioned in the above paragraph (number of 

connections^ nuniber of connections to be supplied by the subject^ intricacy 

of totals and extent of being in the same category) are potentially vorkaible 

categories of research. Of course they need to be defined and clarified^ but 

one might classify arguments according to these categories and see if siibjects 

at various levels can handle them. 

Our difficulty vith these four categories of Burt's is that they do not 
seem immediately useful in making decisions about curriculum and grade place- 
ment of materials. !Ehe reascxi for tiiis is that ve nov th ink in logic in terms 
of valid and invalid arguments^ class and sentence reasoning^ and various 
rules of inference. It vould be i>os8ible^ but inconvenient^ to think instead 
in terms of Burt's four aspects of complexity^ suitably reformulated. Bovever> 
before turning to Burt's categories ve should try to vork vith the established 
ones and see if differential development exists in texms of the established 
categories. Hence the present study is framed in tezms of the established 
categories of logic. It vould be vorthihile in the future not only to repli- 
cate this 8tudy> but to compare the fruitfulness of the tvo conceptual 
schemes. 



Piaget's discussion of four basic features of formal operational thought 
(possession of the truth-validity Characteristic, ability to operate vithin 
a eoiribinatorial framevork, ability to control variables, and ability to do 
propositional logic) provided a conceptual springboard for the framing of the 
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■ibovt slat qufiBtions about the natural^^cultujral develo|iiient of knowledge of 
logic. Althou^ there will be a testing of his claims to sooe extent^ the 
current study is to a greater extent concerned with the extension and re- 
finement of his views. 

The evidence of others supports the contention that there is develop- 
ment of logical ability; does not siq^rt the view that this develppment comes 
in stages; suggests that the basic principles of both conditional and class 
logic are not mastered by age 11-12; siqports the contention that the truth 
validity characteristic is not fully developed by age 11-12; and has little 
to say about the differential development of principles and components of 
logic. The major contribution of the current study to knowledge about the 
natural cultural development of logic is its e^^loration^ concept\ialization^ 
and tentative results on the differential development of knowledge of logic. 

B. THE RESULTS 

Like the previous section this part of Cheqpter V is organized in accord 
with the six listed questions. 

1. Is there a developinent of logical ability as children grow older? 

That our results indicate a positive answer to this question can be 
seen in a nunber of ways. In Chapter IV Tables IV-8 and IV-9^ which give the 
mean pre-test difficulty indices for item groups^ components^ and total test^ 
diow a development from the lowest grade to the hic^est on all item groups 
except #12 conditional^ on all components, and on both tests as a whole. 
Apparently Item Group #12 conditional is Just too difficult for any develop- 
ment to Show within the range with lAiicfa we worked. 

Inspection of total scores on the tests for LDT's, IRBT-l's, and 110)1-2 's 
separately also reveals this development. These scores appear in Chapter 
ni in Table IH-3* TSble V-1 in this chapter presents the mean total pre- 
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test scoires for each grade level/ all aubjecta coel>ined. Again developaent 
with advancing age and grade can be aeen. Ibr interpretation purpoaea thia 
table alao preaenta the meta chronologichl age, IQ/ and eatiaated nent^ age. 
Even thouc^ the IQ acorea are on different teata/ reaulting ffon the cooibina* 
tion of the unxr-2*8 with the othera/ theae acorea help to eiq^in the 
larger Jiaq;)8 found from the ^th to the 7th grade on the conditional reaaoning 
teat and from the 8th to the 10th grade on the claaa reaaoning teat. 

Tbble V-1 alao preaenta the mean pre>teat acorea for all aubjecta com- 
bined on the components and item groiqps. Again development is in evidence 
in every case except for |f^l2 conditional. If one looks more closely at theae 
figures than sinpiy inspecting the figures for the youngest and oldest/ the 
significance of IQ as veil as age and grade is again suggested. 

inhere are altogether 112 different steps from one grade to the next tak« 
into consideration total/ conqponent/ and item group scores. Of these 
stepS/ l6 are dovn/ 2 are at the same level/ and 9^ arc up. Let ua examine 
the l6 steps dovn. Only one of them occurs vhere there is an increase in 
mean IQ from one grade to the next/ and that la again for Item Qroiq^ #12/ 
conditional. Of the others, 6 occur in the shift from grade 7 to 9/ condi- 
tional; 4 occur in the shift from grade 9 to grade 11/ conditional; and the 
other ^ occur in the etift from grade 10 to grade 12. In the first tvo of 
theae three shifts there is an actual decrease in the mean I.Q. In the 
third Aift the mean IQ (120) stays the same. The other 4 shifts (grades 9 
to 7/ 4 to 6/ 6 to 8/ and 8 to 10) are accompanied by increases in IQ. 

Hovever/ there are still some steps that do not quite fit the ex plana tion 
that uses only a coeiblnation of the chronological age, grade/ and IQ factors. 
Pexhapa there is alao a leveling off in grades 9 througji 12 (CA roug^Uly 15 
through 18 years; NA roueh^ 200 through 260 acmtha). We shall return to 
this possibility vhen considering the stage question. 
o 

ERIC 



V-l6 



TABUS V-1. Mean Chronological Age; IQ; Eatioated Mental Age; and Total, 
Conponent, and It^ Qrcnq^ Conditional and Claaa Beaaoning 
Fre-Teat Scores; by Grade for All Subjects Ground Together. 



Grade 
H « 


Conditional Reasoning 
05 07 09 11 

102 99 80 78 


04 

94 


Class Reasoning 

06 08 10 

103 100 75 


12 

72 


Chronological 


Age (nos.) 


129 


153 


184 


203 


H7 


142 


166 


190 


214 


IQ 


108 


117 


no 


109 


109 


112 


U3 


120 


120 


Estimated Mental 
Age (nos.) (CA x 
IQ/IOO before 


rounding) 


139 


179 


201 


220 


127 


159 


187 


228 


256 


Total Score* 


42.4 


51.7 


55.3 


56.6 


44.3 


53.*» 


57.8 


71.2 


73.^ 


Coaoponent** 


CP 


23.3 


27.1 


29.0 


29-5 


25.6 


30.2 


32.1 


38.2 


39.0 


SY 


5.8 


6.7 


6.5 


7.2 


5.1 


5e3 


5.9 


6.9 


7.5 


SU 


4.6 


6.0 


6.4 


6.4 


4.7 


5.6 


6.7 


8.3 


8.2 


Item OrowT** 


1 


*^.3 


4.5 


4.9 


4.7 


4.3 


5.4 


5.5 


5.7 


5.8 


2 


1.4 


1.7 


2.1 


2.2 


3.7 


4.3 


4.5 


5.2 


5.2 


3 


1.2 


1.6 


2.1 


2.0 


1.8 


2.5 


2.9 


4.0 


4.6 


k 


3.3 


4.1 


3.8 


3.9 


2.6 


2.6 


2.9 


3.5 


4.1 


5 


3*4 


4.0 


4.2 


4.5 


3-6 


4.2 


4.2 


4.7 


4.8 


6 


3.3 


4.0 


3.9 


3.6 


3.5 


4.5 


4.7 


5.3 


5.2 


7 


0.9 


1.5 


^ A 


2.6 


2.0 


2.2 


2.3 


3.7 


3.9 


8 


4.1 


4.9 


4.6 


5.2 


2.3 


2.5 


3.0 


4.2 


4.5 


9 


4.3 


4.7 


4.6 


5.2 


2.9 


3.3 


3.5 


3.9 


4.1 


10 


3.3 


4.3 


4.2 


4.5 


2.5 


2.7 


3.1 


3.5 


3.3 


11 


3.2 


4.0 


4.1 


3.9 


2.8 


3.4 


3.9 


4.9 


4.7 


12 


1.6 


1.0 


1.8 


1.3 


3.5 


3.6 


4.2 


4.8 


4.6 



*Total score vas calculated using scoring fontula: R-V/2 27* 

^***Coi90oent and item gxtnq^ scores are nuidber of ri^^t answers. 
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Bevttlppnent of logical ability vitb grade (and thna age) can alao be 
■een in leblea Y-2 and V-3^ ahich preaent the pereentagea of aubjecta at 
each grade abo loet the aufficient condition for naatery (at leaat fire correct) 
of ea(^ principle or coabination and ibo failed to Beet ^e neceaaary condi- 
tion for aaatery (at leaat four correct). A reninder: Thoae eho failed to 
Beet the necessary condition are those ^o Barked correctly three or fewer 
of the iteaa in an item gxmqp* fonce those subjects iftio Barked correctly 
exactly four of an item group neither met the sufficient condition^ nor failed 
to meet the necessary condition. For this reason the percentages do not add 
ip to 100)(, the difference between 100)( and the sum of the percentages given 
for a given grade being 'ttie percentage idio marked correctly exactly four 
itens in an item group. 

An inspection of these two tables again shows developaent in logical 
ability. Differences among princii^es, vhidi were apparent in the diffi- 
culty index tables (lV-8 and IV-9) and in the absolute score table (V-l) 
are again apparent in these necessary and sufficient condition tables, 
dheae will be discussed under the topic of differential devttlopment. 

In stanary there is quite clearly development of logical ability in 
subjects like those wa tested. Sven thou^ this was not a longitudinal 
study^ it would be very difficult to deny the development hypothesis and 
still offer a satisfactory explanation of the data. 

2. Does the daveloBBBnt come in stages? 

As indicated earlier^ the answer to this question depends upon iliat de- 
gree and length of leveling off shall count as a stage — and this depends 
in part upon the general context in idiidi the question arises. Bence for 
this question there are not only problema of errors and gaps in measurement; 
there are alao problcBs of interpretation of the question, fie are thus in a 
position only to aake the most tentative suggestions. 

er|c 
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Graph V-1 depicts the total score vs. chronological age coordinates 
for each test> maki ng use of the means that are presented in Table V-1. 

The lover line connects the points for the conditional reasoning test^ and 
the iqpper line those for the class reasoning test. Since the points are 
^sproxinately tvo years apart in each case^ and since there are only four and 
five sets of coordinates respectively^ the grcphs are difficult to interpret. 
Do they show stages or not? We find ourselves unable to give a firm answer 
to the question. 

However^ there is some indirect evidence against the existence of stages 
or at least in favor of their being less severe, if they exist. This is 
seen in a cooq>arison of Chraphs V-1 and V-2. Graph V-2 plots the same total 
score means against estimated mental age instead of chronological age. The 
points in the mental age grsqph come closer to fitting the speculative dotted 
straight line tiian do the points in the chronological age graph. In oUier 
words “Oie degree of abn^tness that is found in the chronological age gr wp** 
can be at least partially esqplained by variations in IQ from one grade level 
to another. 

naturally this method using estimated mental age is not a precise one, 
since it is based yxpon different tests, and since the relationship betwmen 
IQ score and mental age is a matter of some controveray. But the procedure 
does seem to have merit, so we used it. One must soaie tentative 
assumptions. 

Even with the mental age adjustment, there is still not exactly a 

straic^t line for either kind of reasoning. The data might be eg^laiBed 

by experimental error or measurement, or the existence of stages of some 

sort. Conceivably tiiere are stages for each of ”010 principles of logic. 

If so, they would be masked by this total score treatment. Bagrettahly we 

do not feel that the data of this study are definitive enough to do more 
o 
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than ipeculate about the exiatence of stages in the learnii^ of prineiples. 

In suwBzy the stage question is a vexy difficult one and no deflnitiTe 
ansuer is varranted on the basis of these data. There is «‘vidence against 
the existence of stages (vithin the age range studied) as exti ' cne as Piaget 
posits in his earlier vrlting^ but the question about the existence of aore 
refined stages is largely unanswered, and until the question is refined, 
largely unanswerable. 

3* Is conditional logic aastered by age 11-12? 

There are several different ways of iqiproaching this questicm. One is 
by examin ing Table V-3> ^idi give the percentages at eadi grade level who 
net the sufficient condition and idio failed to aeet the necessary conditicm 
for nastery of each principle. Another way is to look at the total scores 
at the various grade levels, as presented in Table V-1, and judge whether 
any or all of sudi nean scores indicate nastery. A third way is to look at 
the nean difficulty indices given in Chapter IV in Tsble IV-8. Each of these 
ways supports a n^atlve answer to tiiis question, ihether interpreted in 
terms of chronological age or nental age. 

Age 11-12 years is equivalent to 132-1^ nonths. In dironological 
age this corresponds to our 5th and 6th graders, in nental age to our 4th 
and 5th graders. Hence if the answer to ttie question is positive, then 
conditional reasoning should be mastered by our subjects in grade 5, and 
certainly by grade 7. 

Consider Table V-2, the necessary and sufficient condition table tor 

conditional reasoning. Of course one of the most striking thills about it 

is the difference among the item groiqps. But let us leave tiiat fact aside 

for ‘Uie nonent. At grade 7 four of the principles (or coahinations) are 

definitely not mastered; the ones corresponding to Item droiqps 2, 3> 7# 

and 12. The otiier principles (or coahinations) are probably nast^red by 
o 
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roughly half of the aubjects and probably not naatered by about a third 
(vitfa about a aixth falling in the borderline area). Ohe aituation in grade 
5 ahova a leaaer degree of maatery but on Ibe aame order aa in grade 7* 

Hence the anaver to the queation that ia here auggeated ia that there la 
maatery of aone of the principlea by acme of the people of age U*12> but 
rarely (if ever) maatery of all of the baaic principlea and frequent non- 
maatexy of moat of them. 

^en one looka at tiie queatlon *ttixouc^ the mean total acorea one aeea 
rouflbly the aame anaver^ thoufiii it la not aa refined. !Ehe mean total acorea 
for all of our aubjecta in gradea 5 and 7 are h2 and 52 respectively out of 
a poaalble 99* On the face of it theae acorea auggeat that the baaic prin- 
ciples eid>odied in the conditional reaaoning teat are not maatered at thia 
level. Signer acorea on *010 test aare poaalble^ aa demonatrated by the w«f«n 
acore of 00.7 reported in Table III-3 in Chapter in for lllh grade studenta 
lAo have been taught conditional logic by one of our ataff mesbazii. 

Ihe mean dlfflcully Indicea given in Table IV-8 in Chapter IV alao aug- 
geat that conditional reaaoning ia not maatered by age 11-12, the mean total 
teat difficully for gradea 5 and 7 being around 50jt. It should be re«^>ered 
that thin teat vaa not deaigned with the intent of aecuring a mean diffi- 
cully index of around 50^* Inatead it vaa designed with “Uie intent of 
ihether given groigpa of students had mastered certain principles. Such an 
intent requires 'ttiat decisions about item inclusion and exclusion be based 
iq?on ihether the item is deemed on the face of it to be an indicator of 
mastery of the principle. To select an item on the basis of its difficulty 
would be to some extent to build in an answer to the question of itietfaer a 
g^vra principle la mastered. We have not done this. 
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In Bunnary^ it seems clear from any and all of the three nays of pre- 
senting the data that the basic principles of conditional reasoning are not 
mastered by age U-12> given the conten^rary cultural background of these 
subjects. 

Incidentally it should be noted that> althou£b there vas considerable 
improvement from grade 3 to grade 11^ conditional reasoning is not mastered 
by the older group either. 

The mean chronological age of our grade 11 subjects is silently under 
17 years and the mean estimated mental age is 220 months (sli^^tly over l8 
years). Ibe same four principles and conbinations are not mastered by 
these students. 73#> 68^, and 955^ of the Uth graders failed to meet 

the necessary condition for mastery of the principles and r*omb 1 nation 
corresponding to Item Groups 2, 3> 7> and 12 respectively. And the mean 
score on the total test vas only 37 out of the possible 99* 

Ihis is not to say that the Uth graders are Incapable of mastering the 
basic principles of conditicmal logic. It is slowly that under contesporazy 
conditions they do tx)t do so. That they are capable of much more is shown 
by the performance of the Uth graders vho were tau^t logic by a Qf 

our staff. Ihis is one of ■ttie striking findings to be presented in the 
next chapter. 

Is class logic mastered by age U-12? 

Ihis question vlU be approached fjrom the same three vantage points. 

If the answer to the question is affirmative^ then, considering the age 
equivalents mentioned und^r ’ttie conditional reasoning discussion, our sub- 
jects in grade 6 should have mastered class reasoning. 

Consider Sable V-3, the necessary and sufficient condition percentage 
table for class reasoni ng * Again differences among item groins are notable. 
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thouc^ they are generally not so extreme as in conditional reasoning* And 
again some of the principles are not mastered by the majority, since over ^ 
fail to satisfy the necessary condition for the principles and cooibinations 
corresponding to item groups 3, k, 7, 8, 9, and 10* Only for two principles 
is the sufficient condition satisfied for more than 50^ of the grade 6 siib- 
Jects. Thus the necessary and sufficient condition tables indicate that the 
basic principles of class reasoning are not yet mastered at age 11-12, 
idiether put in terms of mental age or chronological age* 

A similar conclusion can be dravn from the mean total score, vhich is 
given in Table V-1 as 53 out of a possible 99 for the 6th graders* And the 
mean difficulty index (5^) &t the 6th grade level, vhich is given in Table 
IV-9 in Chapter IV, supports the view that the basic principles of class 
reasoning are not mastered by age 11-12, though of course there are some 
students vho have mastered some of them. 

Even the oldest subjects, those xn grade 12 (mean chronological age of 
sli^tly \mder l8 years and mean estimated mental age of 256 mos., or 
sli^tly over 21 years*) have not fully mastered the basics' of class reason- 
ing, althou^ they seem to come fairly close* Fox only two principles have 
over 805^ of them attained the sufficient condition, and for five principles 
(or cooibinations) over 25^ of them have failed to meet the necessary condi- 
tion* Their mean score on the test is 73 out of the 99 possible, and their 
mean difficulty index is about 73^. 

With a groi^ at this state of advancement, the question, *^ve they 
mastered class reasoning?" needs a more refined answer than the question 

^Whether a mental age of 21 years makes sense, given contemporary IQ theory, 
is an interesting question, but one ^i(di ve do not have to resolve here* 
Idien we are at this level, ve can simply arbitrarily define 'mental age* as 
the product of IQ and CA divided by 100, and use the result as what we sus- 
pect is a better Indicatcur (for our purposes) of mental developBest 
either IQ or CA would be alone* 
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esg^licltly requests. Ihe answer would prbbaibly go sonething like this: 
Probably some of them have mastered all of the basic principles^ some have 
mastered most and some have mastered only a few. Ihe above statement is 
qualified with the word 'probably' because our analysis is of groups^ not 
of individuals. The above answer would explain the data. 

Thus ve do not find full mastery of class reasoning even at age 17-18. 
Hence Piaget's characterisation of the concrete (^rations period as one in 
idilch class logic can be done deserves qualification^ if our data are taken 
at face value. Class logic is not^ under the cultural conditions of our sub- 
jects, fully mastered during the concrete operations period. Not until 
some years later is mastery of the basic principles of class logic approached. 

However, Piaget's contention that class logic is easier than sentence 
logic receives some support from the above analyses, thou£^ the stage form 
of his conclusion is not siqiported. That is, rig^t down the line class 
logic scores are generally hi^er than conditional logic scores (this assumes 
that conditional logic scores are representative of scores that would be 
obtained on a cooplete sentence logic test). But it is not a matter of one 
being mastered at one stage, and then the other being mastered at another 
stage. Instead neither is fully mastered by age 17-18, and both appear to 
be developing fairly regularly iq> to that age. 

Mainly because the conditional and class reasoning tests were given at 
different grade levels, we did not perform tests of statistical significance 
for the differences between performance on them, feeling that such compari- 
sons could be made at some other time on subjects who take both tests. But 
Graphs V-1 and V-2 do suggest differences in overall performance on class 
reasoning and conditional reasoning. It is the sort of difference suggested 
by these graphs that supports Piaget's implicit contention that class logio 
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is easier than sentence logic. Naturally the support mist he qualified hy 
the lack of tests of statistical, significance^ lAiich ve feel should vait 
\mtil more directly cooparahle scores are available. 

5» Is the truth-validity characteristic achieved by age 11-»12? 

The data suggest an ansver of "Partly" to this question. Tables IV-8 
and IV-9 of CSiapter IV present the mean difficulty indices for the suggestive 
Items^ of vhich there vere twelve in each test. Ihese suggestive items, it 

OfUi, 

will be remembered, siKdi that the truth status of the conclusion is dif- 
ferent from the validity status of the argiment, so a person who cannot 
Judge the validity without being swayed by his beliefs will do poorly on 
these items. 

Ihe mean difficulty indices for the conditional reasoning test sug- 
gestive items are 41.3 and 53*4 respectively for grades 5 and 75 hence the 
average siaggestive item was marked correctly about 4l^ of *Oie time by 5th 
graders and 53^ by Jth graders. On the class reasoning test the correspond- 
ing figures are 4o^ and 47^ for 4th and 6th graders. Ihese percentages 
Indicate that there is a degree of achievement of this characteristic, but 
that the achievement is not complete. 

The percentages for the Uth and 12th graders on the conditional and 
class tests respectively are 6o^ and 67^. These show greater achievement of 
the truth-validity characteristic, but still indicate that the achievement 
is yet lncooq>lete. This result is of course to be esqpected from the findings 
reviewed in Chapter IV under the topic of Wilkins' suggestive logic content. 

In sum the truth-valldily characteristic is partly achieved by age 
11-12 and to a greater extent by age 18, thou^ it is still incoupletely 
cudiieved on the average by students of the latter age. There are incidentally 
Interesting differences between conditional and class reasoning on tills truth- 
valldily diaracteristic, differences which will be discussed under tiie next 
question. 



within each type of logicj Is there a develxament of one sort of thing 
before another. If soj nHiat Is the nature of this differential derolggaent? 

Since there are virtually no suggested ansvers from the literature on 
this question^ and althou^ some of the differences that will be suggested 
in this section seem fairly clear-cut^ this research Is largely ei^oratory* 
!Eheoretical background and/or replication are needed* 

a. Differential Develqpment of Knowledge of Principles of Logic . 

Fallacies . !Che most striking difference among the raw scores^ 
difficulty indices^ and necessary and sufficient condition percentages for 
the principles is the difference between the principles which express the 
basic fallacies and those which esgpress the basic validities* Ihe principles 
expressing the fallacies are those which specify certain conditions idiich 
fail to entitle one to draw a conclusion of a certain type* Conditional 
reasoning Principles 2, 3/ It and 12 listed in Table II-l and class 
reasoning Principles 3> ^t 7 listed in Table II-2 in Qiapter II are the 
fallacy principles* As shown by Tables IV-1 and IV-2 in Chapter IV, these 
principles (except for conditional 12) are embodied in Conditional Item Groins 
2, 3t It 12 and Class Item Groups 3t It aod 8 * Their symbolic mani- 
festation is also presented in the tables in Chapter IV* Ibr quick identifi- 
cation in Tables IV-1 and IV-2 one can use the answer 'Maybe' as a sign of 
a fallacy item group* 

All other principles are classified as 'validity principles'* They 
describe or Indicate a logical move that one is entitled to make* There are 
two kinds of item groups embodying the validity principles, those in tdiich 
the proposed statement follows necessarily (thus giving a valid argument), 
and those in ^Ich the proposed statement is the denial of a statement which 
follows necessarily* Items fitting the distinction between these two types 
of item groups are keyed 'Yes' and 'No' respectively* Hence items embodying 
validity principles are those keyed either 'Yes' or 'No'* 
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An inspection of Tables IV-8 and IV-9 in Chapter IV shows that at the 
lowest grade levels (4 for class and 5 for conditional) the 'Maybe' itea 
groiqps have the fotnr lowest mean difficulty indices for each of the tests. 
These 'Maybt' item groups are the most difficult in each test at that level. 
Boug^ly the same situation holds in the necessary and sufficient condition 
percentages given in Tables V-2 and V-3. Conditional Item (h-oups 2, 3, J, 
and 12 and Class Item Groins 3; 4^ 7^ oQd 8^ ^ich are the 'Maybe' item 
groups, are the most difficult in each test, with one minor exception.* 

At this &je level (CA of 10-11; estimated MA of 11-12) students seem 
betiier able to tell that something \diich follows, does follow; than that 
something which does not follow, does not follow. 

Purthennoi ■> there is generally considerable in 5 >roveaient among the 
'Maybe* items. Qhe actual in 5 )rovement for each item group is shown in 
Table V-4, which is derived from Tables IV-8 and IV-9. 

Table V-4 shows that the largest amount of Item-groi^ improvement for 
each type of reasoning is registered for a fallacy item groiqp (conditional J 
and class 3)* In class reasoning the next two largest improvements are also 
for fallacy groips (8 and 7)> find the fourth fallacy group (4) is amon g the 
top ones in inprovement. In conditional reasoning two other fallacy groups 
(2 and 3) fii*e high ones in improvement; the fourth however (12) is the 
lowest in inprovement, presumably because it is so hard. Furthermore it is 
not a p\zre fallacy group; it is the only one which embodies a conibination 
of principles. 

It appears then that althou^ the fallacy principles are the most dif- 
ficult at ages 10-12, there is great inprovement in knowledge of these princi- 
ples as students grow older. 




*In the sufficient condition table for class reasoning. Item Oroip 10 intrudes 
by two percentage points. 



TABI£ V-4. Difference Between Lowest Qrade and Hifi^est Grade Mean Item Grotqp 
DLfflc\ilty Indices; Item Cbroup Answers 



Item 

Group 


Conditional 

Difference 


Answer 


Class 

difference 


Answer 


1 




Yes 


17.3 


No 


2 


12.6 


Maybe 


26.7 


Yes 


3 


18.0 


Maybe 


44.2 


Maybe 


k 


9.3 


No 


23.3 


Maybe 


5 


19 .^ 


Yes 


15.3 


Yes 


6 


8.8 


Yes 


24.8 


No 


7 


29.1 


Maybe 


29.1 


Maybe 


8 


17.1 


No 


34.5 


Maybe 


9 


16.8 


Yes 


15.6 


Yes 


10 


22.9 


No 


15.7 


No 


11 


12.6 


No 


26.2 


No 


12 


-5.3 


Jfaiybe 


4.9 


Yes 



Note: Item groiqo answers are given because they indicate Ihe l^pe of item 
group: *Maybe* for fallacy item groins; ‘Yes* for item groups in ‘tdiich the 
conclusion to a valid argument is offered; and *No' for item groins in 
which the denial of a conclusion to a valid argument is offered. 

The question inevitably arises as to lAiether^ using these imp.'Ovement 
figures^ the actual ir^rovement in amount of kisovledge is necessarily being 
con 5 )ared. After all there is inevitably little in^rovement on a test i^ere 
there is little room for in^jrovement, it mi^t be argued. 

In a way there is point to this view, but it neglects the unique 
feature that is built into these tests. They are intended to be tests of 
mastery . If someone has mastered a particular principle or skilly then there 
is not much room for further development of knowledge of the principle or 
skilly althou^ there ml^t well be room for other kinds of develppoent. 

Given our aesusiptlon that these are tests of mastery^ then the conpcurlsons 
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of amount of inprovement are legitimate. But it Should bourse be remem*- 
bered that there mi^t veil be inqprovement in other things lAiich is neglected 
in the comparisons that are being made. More specifically^ given our assump- 
tions^ there is on the vhole more iiQ>rovement in the fallacy principles than 
in the other principles for ^ich ve tested. Ihis does not preclude there 
having been an even greater improvement in some of the principles^ skills^ 
and/or combinations thereof for vhich ve did not test. 

nils defense of principle Improvement conparisons does not extend to 
component and total score comparisons^ for those are not master:' scores. 

In those conparlsons differences in improvement scores ml^t not reflect 
differences in amount of isprovement in the thing being measured. Artificial 
test ceilings might be operative. 

2) Ihe converse , ftoughly speaking a converse of a statement is "ttie 
statoaent vith the parts reversed. One basic fallacy rule is that a state- 
ment does not liiply its converse. In other vords: 

Ihat all A’s are B's does not imply that all. B's are A's. 

*If p, then q* does not isply 'If q, then p*. 

!3iese tvo rules are among the most basic in the practical application of 
logic. They are put more precisely as conditional Ibrinciple 7 and class 
Principle thich correspond to the item groips of the same number. 

A striking thing is that in each type of reasoning it is the converse 

principle vhich is the most difficult at the lovest level, and in ihlch there 

is the greatest improvement over the years. Conditional Item Group #7 

registering a mean difficulty index difference of 29.1 and Class Item Chxjip 

#3 a difference of 44.2 (see Tables IV-8, IV-9, and V-4). Similar results 

appear in the rav score table, Table V-1. The tvo elementary converse item 

groups start with the lowest raw scores and register the greatest absolute 

gain over the range that we tested, 
o 
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Ohe results are not qiiite so striking (thoufi^ alaost so) lihen the neces- 
sary and sufficient condition taibles> Tables V-2 and V-3# are exanined. In 
each case the converse principles tie for the position of greatest difficulty. 
Furthermore the siiople class reasoning converse item group (#3) does register 
the greatest gain in percentage meeting the sufficient condition and the 
greatest reduction in percentage failing to meet the necessary condition. And 
the conditional reasoning converse item gimp registers the greatest reduction 
in percentage failing to meet the necessary condition. But it does not regis- 
ter the greatest increase in percentage satisfying the sufficient condition^ 
presuDably because not enough siibjects even at grade 11 have mastered the 
converse principle. 

Another interesting fact about the converse principles is that at the 

J' 

top grade levels in our range they had (as shown in Thbles IV-6 and IV-9) 
hi£^ mean discrimination indices^ the highest for conditional reasoning 
(33*2^) and among the hie^est for class reasoning idiich is 1.7 per- 

centage points from the highest). Hence an understanding of the fallacy of 
conversion is> of the sid>test factors with which we worked^ among the most 
closely related to total perfoxmance on the logic tests. 

In sum the greatest improvement within the range of levels measured in 
this study occurred for the converse inrinclples of bo'Ui conditional and 
class reasoning. Hhese principles for ages of roughiy 10-12 were the most 
difficult and for those around 17-18 were among the most discriminating. This 
is in some contrast to the contraposition principles^ which we consider next. 

3) The Contrapositive . 

Bo\]ghly speaking the contrcpositive of a statement is the statement with 
the parts reversed and negated. A statement does imply its contrapositive. 

In other words: 




!Ehat all A's are B's does laqply that all non-B'a are non«A's. 

'If then q' does imply 'If not q^ then not p'« 

Ihese two rules are put more elegantly as Conditional Principle 6 and Class 
Principle 8 in TShles II-l and II-2 in Chspter II* They are directly tested 
for hy Conditional Item Group 6 and Class Item Groiq) 9> ^ovn in Tables 
IV-1 and IV-2 in Chapter IV. 

These item groxqis are of medium mean difficulty at the outsht (56.^^ and 
51*1^} and there Is a very modest amount of ingtrovement in each case (8.8 and 
15*6) compared to the other item gro\;q>s in a given type of reasoning test. 
Each of these inqjrovement figures is the third smallest for its type of 
reasoning, furthermore at the outset each contraposition group has a high 
discrimination index (^*6^ and 4l.5^t), vhlch drops considerably by -the end 
of the period with ^ich we worked and 26,Tf>). This is Just the re- 

verse of the trend for the conversion discrimination indices. 

One wonders how to explain these differences between the conversion and 
contraposition principles* Perhaps the conversion principles are more the 
sort of thing that people can learn than the contraposition principles^ 
abiliiy^t which is essentially native^ rather than acquired^ and develops 
early in life, if at all. That would explain the difference in the amount 
of inprovement between the two kinds of principles. And it could 
the initially poorer performance on handling the fallacy of conversion, which 
mi£^t not yet be learned at the early levels* Furthermore, it could 
the greater early discriminating power of the contraposition item groups, as 
contrasted with the greater discriminating power later on of the conversion 
groups, on the assumption that learning plays a larger role in test perfor- 
mance as people grow older. 

This explanation is in accord with our experience in teaching logic. 

We found that the conversion principle, when e^lalned, was fairly easily 
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understood by all students, but that the contraposition principle ¥as either 
understood rifi^t away or not at all. Contrc^sition did not seem as teacfasible 
as conversion. 

A second possible explanation is that these subjects over the years 
receive deliberate Instruction in the conversion principles, and not in the 
contraposition principles. Ihe fallacy of conversion Is regarded as a great 
evil by social studies teachers. Contraposition, on the other hand, is in 
the experience of the vrlters regarded as an Isqportant tool by only a few 
mathematics teachers. 

I 

A third possible explanation runs as follows: !Die high-scoring students 
in the early grades answered the conversion and contraposition items on the 
basis of whether the conclusion feels or sounds like the premise. Given that 
nobody at these early ages is any good at logics the ones who worked this way 
could get the hlg^ total scores and would get the conversion items wrong and 
the contraposition items right. In the early grades that would make the 
foimer items more difficult and the latter more discriminating. Later on 
students begin to reason logically and the high scorers are those idio do so. 
They get the conversion items rig^t because they know better, but they miss 
the contraposition items because a little knowledge is a dangerous thing. 

Hence the conversion items become easier and more discriminating, while the 
contraposition items become little easier and less discriminating.* 

Research is needed on ihe reasons for this difference between the conver- 
sion and contraposition principles. It could be quite fruitful in helping our 
understanding of intellectual ability and development. 

4) foansitivity . 

A transitive relation^lp is one \dilch, so to speak, passes with order 




*lhis explanation was suggested by Prof. Jason Hillman. 



preserved tfarougih an Intezmediary. Inpllcatlon and class inclusion are 

transitive relationdiips* In other vords: 

Given that p implies and that q implies r, ve can conclude that 
p implies r* 

Given that the class of A's is included in the class of B's and 
that the class of B's is included in the class of C's^ ve can 
conclude that the class of A's is included in the class of C's* 

The transitivity principles are conditional and ^ class* They correspond 

to the item groups of the same nuniber* In the class reasoning test^ Item 

Group 11 calls for the double aj^ication of the transitivity principle* 

At the outset in our range the transitivi'ty principle item groi;q>s are 

of medium ease, with mean difficulty indices of 56*7^, 55.7# and 52*1^* 

Althou^ they start out at this level of ease there is still considerable 

ingKrovement registered for each in the range covered; 19*^/ 26*7# and 26*2 

percentage points respectively* On the vhole their discriminating power as 

given in the discrimination Indices is someidiat better than that of most of 

the item groups* 

Thus the transitivity principles, althou^ they start out fairly easy, 
are ones in vhich there is considerable inprovement given the range within 
vhich these tests were given* 

5) The Copa>arability of the Two Types of Logic * 

One rather striking feature of ttie above discussions of fallacies, con- 
version, contraposition, end transitivitjT^ that it appears that there are 

« 

definite s imi larities between the two lypes of logic being studied* The 
thesis that suggests itself is that psychologically, althou^ conditional 
reasoning is more difficult, there are basic simUarities between the two 
lypes of reasoning, and that grasp of the three basic rules of conversion, 
contraposition, and transitivity follows similar develppoental patterns in 
each type* This is a thesis vhich can only be suggested on the basis of 
this study* It must be checked by further investigation* 
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b. Differentia] Developiaent of the Piree Coqponente; Concrete Ptoillari 
gyaibollej and Suggestive » 

As ^ovn in Table V-5 there is development in all three of the compo- 
nents on both tests. In each case the greatest development is on the 
suggestive component^ next the concrete familiar component, then the symbolic 
component. 

Table also shovs a very striking difference between conditional and 
class reasoning in the comparison of components at each grade level. In the 
conditional reasoning test the differences among the components are small, 
varied, and not statistically significant. 

In contrast there are regular differences among the same cooponents on 
the class reasoning test, the concrete familiar being easier. At three 
(6, 8, and 10 ) of the five grade levels, the differences between the con- 
crete familiar and the symbolic conponents are statistically significant 
(5# level) and in the other two are nearly so. The differences between the 
concrete familiar and suggestive components are less marked but an inspection 
of the chart shows 'Qiat they are regular. At grade 6 the difference is 
statistically significant; at grade k it comes within two tenths of a per- 
centage point of being so; and at the other three grades the differences 
are about two-thirds of idiat is needed for statistical significance. 

These tests of significance are the relatively conservative Tukey test.* 
When the less conservative t-test was performed on the above differences at 
each grade level, dll except those at grade 4 tiumed out to be statistically 
significant. Furthermore, using the t-test, none of the conditional reason- 
ing cooponent differences are significant. Because of a conservative leaning, 

4 

we report the Tukey test results in Table V-^, but do find the t-test results 
rather striking, so we mention them too. 

♦See: I^ran, Thomas, A. "Multiple Conparisons in Psychological BesearchV. 

Psychological Bulletin, Vol. 56, Mb. 1, Jan. 1954. 
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ZABI£ V-5* Con5>arisons of Mean Difficulty Indices of Three Conqponents; Concrete Familiar, Symbolic 
and Suggestive. 
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Except at the lowest level (grade k) the suggestive conponent is not 

J 

so difficult as the symbolic conponent* !Ehe differences are not statistically 
significant using the Tukey test^ as can be seen from an Inspection of 
Table V-5. 

One wonders ^Aiy there are these regular s\:perloritles in the class 
reasoning test of the concrete familiar conqponent over the symbolic and 
suggestive components^ but not in the conditional reasoning test* Two ideas 
have occurred to us^ one for the CF-SU comparison and the other for the 
CF-SY comparison* Each will have to be checked by further research* 

It mic^t be that something analogous to the suggestive component is 
already a part of all of the conditional items because of their "ifiy" 
nature. Vhat the subject is asked to suppose is the conditional statements 
on the conditional reasoning test is not simply that something is the case^ 
but rather that, on another sigipositlon (the if-clause) something would be 
the case* In tdie class reasoning concrete familiar items, if the subject 
accepts the initial invitation to sippose something, tiien he is working with 
idiat he believes to be true — for the purposes of the test. But with the 
concrete familiar conditional statements what he is working with, though be 
mi^t well believe it to be true, is the Implication of another supposition . 
Thus he is forced to think in terms of what is implied, rather than What 
is true. 

Perhaps the above hypothesis is unsatisfactory — either because it is 

false, or because it is vague* But it does appear reasonable and mider- 

standable* It would explain the difference between the two tests on the 

CF^SU comparison. According to this explanation, the conditional CF items 

are also SU items and thus have the SU difficulty built into them* Cius we 

would e^qpect no difference between the CF and SU components on the conditional 

test. The class reasoning CF items on the other hand do not have this 
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coD^onent built in^ so ve can eaq>ect a difference^ on the assusqption vhich is 
supported by the literature cited earlier that SU items are generally more 
difficult than CF items* Ihe research that has been done has used syllogisms^ 
^ich are categorized as class reasoning* 

This hypothesis might also explain the apparent greater difficulty of 
the conditional reasoning test. One mi£^t veil expect thls^ if something 
analogous to the suggestive component is built into all the items on the 
conditional reasoning test* 

Turning to the CP-SY conqaarisons, the greater difficiilty of the symbolic 
items on the class test is not s\irprlsing^ since vorklng with variables is 
presumably more difficult than vorklng vlth familiar categories* On the 
other hand there is no cosparable difference in the conditional reasoning 
test. This is surprising* One possible explanation is that the symbolic 
component in the conditional test does not use variable s> but instead talks 
about the existence or non-existence of letters. That is, the items that 
are used are of this type: 

If there is an X, then there is a Y* 

Biere is not a Y. 

Therefore there is not an X. 

They are not of this type, in vhich the letters are clearly variables* 

If p, then q* 

Not q. 

Therefore not p* 

Perhaps it is the use of symbols as variables, rather than sisply the use of 
symbols that makes for difficulty* If so, then the difference betveen the 
class and conditional reasoning tests on the comparison betveen the concrete 
familiar and symbolic components is understandable* 
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It appears then that the order of difficulty of these three conqponents^ 
if one accepts the auxilliary hypotheses mentioned above, is as follows for 
o\ir subjects: concrete familiar, suggestive, and symbolic (listed in order 

of increasing difficulty). This order of difficxilty, vhlch appears starting 
roughly at ages 12-14, is the same order that Wilkins found (1928, p. 77) • 

C. CBAFEER SUMHARf 

Biis chapter presents a review of the literature and the results of our 
study of the development of knowledge of conditional and class logic of 
students rou^ly in the chronological age range 10-18 under the environmental 
conditions of a contemporary ipstate New York area. These students had not 
to our knowledge been deliberately exposed to instruction in deductive logic. 
1. The Literature . 

The review of the literature focused on the work of Jean Piaget. Pou" 
basic features of his formal operational period of thou^t, idiich he holds 
runs from age 11-12 onward, were described. They are l) possession of the 
truth-validity characteristic; 2) ability to operate within a combinatorial ^ 
ftramework; 3) ability to control variables; and 4) ability to do proi>ositional 
(sentence) logic. Only the first and fourth, as we interpret these features, 
are basically logical. 

The testing of Piaget’s views, because of their vagueness, was not the 
primary emphasis of this chapter. Instead it was concerned with questions 
Tdilch are interesting, practically inportant, and were generated from a 
consideration of Piaget’s interests and concepts. Hence this part of the 
study is to be considered an attempt at extension and refinement of Piaget's 
work, rather than primarily a testing of his views. 

The review of the literature (including Piaget's work) suggested the 



following: 



a. 'ihat there is a development oi’ logical ability as children 
grow older. 

b. ihat no stages in this development have definitely been 
identified. 

c. Diat there is no work on the extent of xnasteiy of conditional 
logic in adolescence. 

d. !Ehat one might infer that Piaget thinks that class logic is 
mastered by age 11 - 12 . 

e. Siat the truth -validity characteristic is not achieved by 
age 11 - 12 . 

f. Hhat there is practically no study of the different develop- 
mental patterns of different principles and components of logic w 

2. Findings . 

Briefly (and with mai^ qualifications omitted) the findings are as 
follows : 

a. In this age range there is a development of ability to do logic 
as students grow older. 

b. If there are stages in this range^ they are not noticeable at 
the level of refinement of our measuring techniques. 

c. Hie basic principles of conditional reasoning ere not generally 
mastered by age 11 - 12 , nor by age 1 ?. 

d. Ihe basic principles of class reasoning are not generally 
mastered by age 11 - 12 , nor are they fully mastered by age 17 . 

e. The truth validity characteristic (the ability to consider 
questions of validity regardless of belief in truth of the 
parts of an argument) is not attained by age 11-12, nor by 
age 17 . 

f. Bie patterns of development and mastery of principles of logic 
vary, but there is considerable similarity between the two 
■types of logic s'tudied. Ihe principles esqpressing "the basic 
logical fallacies are the most difficult at ages 10 - 12 , but 
are also the ones in vhich "there is generally the most iiiq>rove- 
ment over -the range studied. Ohe most extreme exangple is ’the 
principle -that a statement does not imply its converse. Bie 
principle of contraposition is one which in this range starts 
at medium difficulty and does not become much easier for older 
students. Ihe transiti'vity principle s-tarts in this range at 
medium difficulty, but is considerably easier for older 
students. 
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Of the three conponents tested, generally the concrete familiar 
was "tile easiest; nerb came the suggestive; and most difficult 
was the symbolic. 

h. Of the three components tested, the greatest difference between 
earlier and later ages was in the suggestive coioponent. 

i. Class reasoning appears to be easier than conditional reasoning 
at all levels. 

3* Heeded Research . 

Bie following types of further research are called for: 

a. A more refined study of the possibility of stages of develppment 
of logical reasoning abiliiy. 

b. An extension of the investigation to younger age grot^s, 
peibaps the first half of each test. 

c. Diis investigation ^ould be repeated on different kinds of 
children. 

d. Investigations, similar to this one should be performed for 
ottier types of logic and for loose reasoning with these two 
types and the others; reqpiired first are prior investigation 
of these other lypes of logic and of loose reasoning. 

e. A check on the conqparative difficulty of the two types of 
reasoning, and the principles and conponents, ng both 
tests on the same students. 

f. A check should be perfoxmed on the effect of a synibol's being 
8 variable. 

g. Bie question of the existence of basic psychological differences 
between conditional and class reasoning should be investigated 
further. 

h. Jbrttier tests should be performed on the hypotiiesis that 
mastery of the principle of contraposition is more related 
to inherent ability than is mastery of the principle of 
conversion. Feihaps controlled amounts of time could be 
spent teaching each at various age levels and the amounts 
of learning analyzed. 




CHAFEBR VI. Ihe Development of Readiness to Master Logie 



Qiie topic of this chapter is to be clearly distinguished from that of 
the last, because we are here concerned wljh uhat students can come to know 
— not with what they know already. First of all, because readiness is a 
key concept in this chapter, we shall present an examination of the concepts 
readiness and readiness to master a principle . Then, after noting the dearth 
of literature about readiness to master logic, we shall describe the 
experimental procedures, including the teaching that we did, and present the 
results of this Inevitably limited study of the readiness question. These 
results will be organized around two questions; 

1. What did our subjects learn? 

2. Can we state what others are rea^ to master? 

A. WEAT IS READINESS? 

Ihe forthcoming discussion of readiness and readiness to master a 
principle is oriented toward the \atlmately practical concern, the teaching 
of logic. Hence some qualifications whidi mic^t have to be made, were we 
considering these concepts in other contexts, will not be crucial here, and 
will not be made. For our purposes the ensuing discussion should suffice. 

At some other time and in some other place, a general discussion of the 
concept readiness would be in order. Biis is not to deny that w»**h of idiat 
follows is general, but simply to limit the problem. This Is not intended 
to be a definitive treatment of the concept re«^<»<»ss . 

1. Capacity end WllllT^ess 

When one inquires \diether a' person is ready to do something, one is 
not asking ifticQier he has done the soswthing, and one is not airily 
idiether he w|^ do it, for someone might never do the tfaii^, even 
he is rea^ to do it. One is as k in g in part whether he has the capacity to 
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do it. But not only this. Someone might have the capacity to do something, 
but be declared not ready to do it because he is not willing to do it. 

To say that a person is ready to do something is to say that he has 
the capacity and sufficient willingness to do it, uhich in turn implies 
that he probably will do it, given suitable conditions. 

2. Dispositional Terms . 

In philosophy there is a technical name for terms that apply to traits 
Tdiich are evidenced under suitable conditions. Such terms are caUed 
’dispositional terms’. Ihe standard example is ’soluble’. To say tliat a 
piece of sugar is soluble is not to say that is has dissolved, nor that it 
will ever dissolve, but simply 1diat under suitable conditions it will dissolve. 
Since readiness is a trait that is evidenced under suitable conditions, the 
term ’ready’ is a dispositional tenn. 

’Mastery of a principle’ is also a dispositional term. If one says of 
a person that he has mastered a principle, tiien one implies that under 
suitable conditions, the person will behave in a certain manner. Fbr example, 
if one claims that a person has mastered the principle that affirming the 
antecedent of an accepted conditional commits one to the affirmation of the 
consequent, then one is committed to the person’s accepting as valid siEq>le 
arguments of the form used for Conditional Item Group 1. 

So far ihat has been said about the term ’mastery* is noncontroversial. 
That is, it is not controversial that a person who has mastered the prin- 
ciple in question should be able to do something of the sort, under suitable 
conditions. Mhat might be argued is whether the person should be e^qpected 
to get correct at least four of Item Oxoup #1 on ’’The Cornell Conditional 
Beasonlng Tbst, Pbrm X". The particular behavioral expectations that one 
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has be argued, but that something of the sort is required hardly 

seems arguable. 

3* A Double RLsposition . 

Bie combination of terms, *ready* and 'master a principle*, appearing 
in the phrase 'ready to master a principle', is doubly dispositional, once 
for the readiness concept and once for the mastery concept. Botighly speaking, 
to say that a person is ready to master a principle is to say that he has 
the disposition, given suitable conditions, to develop another disposition, 
idiich, given suitable conditions, he will show in an appropriate we^. 

IhuE the inference path from a person's behavior to a statement about 
his readiness to master a principle is not a simple one. More manageable, 
althou^ certainly not simple, is the inference path from a person's behavior 
to statements about uhat he has mastered. The operational definitions of 
'mastery of X principle* given in Chapter IV represent a rule of thumb 
procedure for traveling on such an Inference path, a procedure iihich peihaps 
is imperfect in detail, but ve think satisfactory in general approach. 

Elusiveness of Beadiness . 

In addition to this doubly dispositional feature of readiness for 
mastery, there is another problem in Inferring from behavior to«fadiness for mastery. 
Die readiness disposition is more lik^^ the disposition to explode than the 
disposition to dissolve. When sugar has dissolved, it has not lost its 
disposition to dissolve, for if we let the water evaporate, the sugar 
residue will dissolve again. But if some powder is explosive, then once 
it ejqplodes, it will not any longer have the disposition to explode, no 
matter how long we wait around. Similarly, if a person is ready to master 
a principle — and then masters it — he is no longer ready to master it. 

^ direct evidence that a person is ready to master 
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something (evidence of the sort that tells «s directly that a certain powder 
is soluble) — although we can get direct evidence that he was ready. 

Just as we can directly find that some powder jras explosive, so can 
we find that a person ^ ready. We directly find that some powder was 
exploBlve When we discover that it did explode. We discover that a person 
WM ready to master a principle by noting that he ^ master it. 

Ohus there are some dispositions that are retained while exercised and 
some that are lost as soon as they are exercised. Readiness to master a 
principle unfortunately is one of the latter type. We are interested in 
knowing idiether it exists before it is exercised. Once exercised, it is 
gone, and we are no longer interested in the fact that it was present — 
except for special purposes, like this study. We want to know whether a 
person is ready, but we want to know this before he exercises this disposition. 
Ohis characteristic of the concept readiness to master a principle obviously 
probXciBS fop i/his soirt of pcsdincss s^u^y* 

Is there then a to find out if a person is ready to master a 
psrinciplei Ideally the may to make this discovery would be to find an 
identical person, provide Ihe suitable conditions, and then see if this 

identical person masters the principle. If so, then Uie subject is ready. 

If not, then he is not re&dy* 

There are obvious difficulties here: first, the Identical person is 
unavailable; even if he were, he could not be identified; and even if he 
could be, it would be Inconvenient to arrange to put him tbrou^ the paces 

every time we want to see if our subject is ready. Furthermore, the phrase 
'suitable conditions' is vague. 

5» ^.^^^a]^i^wte _^^r_^e__Ideg^cal Person . 

A roucdi cosproDlse as a vay of meeting the identical-person difficulties 
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is the study of a range of people. Such study vlll call for the measurement 



of one or more variables lAiidi are correlated with the extent^ after the 
suitable conditions have been provided, of mastery of the principle. 

Iht-e correlations could be \ised in the development of multiple regression 
equations, \diich would serve the function of predictor equations since the 
values of the variables, as determined before the introduction of the 
suitable conditions, would be correlated with the extent of mastery, as 
determined after the introduction of the suitable conditions. The worth 
of these predictor equations would depend on the conibined strength of the 
relationships between the predictor variables and the variable to be predicted 
(extent to which the principle has been grasped). 

Then one or two lines must be drawn separating that degree of achieve- 
ment ^ich is deemed to indicate non-masteiy and that degree •idiich is 
deemed to indicate mastery. These lines need not necessarily be sharp, 
but for some purposes, it is convenient to make them artificially sharp. 

This artificial sharpness, idiich is “Uie state of the lines drawn by the 
operational definitions described in Chapter IV, will result in some mis- 
takes in the treatment of borderline cases, b\rt for practical purposes, 
this likelihood of mistakes must be accepted. Some of the mistakes can 
be avoided by deliberately introducixig an area of uncertain*^ in the present 
study (exactly four is the area of uncertaln'ty) . 

Thus, neglecting for the moment the difficulty inherent in the vague- 
ness of the texm 'suitable conditions', a rouj^ scheme mig^t be developed 
for determining someone's readiness to master a principle. The values of 
the correlated variables for a given person can be put into the prediction 
equation and a predicted degree of grasp of the principle comes out. On 
the approach (the one taken here) ^ich makes use of an area of uncertainty. 
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there will be tvD llnee^ t^ich vlll be called the "neceasary condition 
line” and the "sufficient condition line". If the prediction falls belov 
the necessary condition line, then ve Judge that the person is probably 
not ready to master the principle. If the prediction falls between the 
two lines, then we withhold Judgment. If it falls above the sufficient 
condition line, then we Judge that the person is ready to master the 
principle . 

On the simpler approach which does not make use of an area of uncertainty, 
the Judgment would sin5)ly depend on whether or not the prediction falls 
above or below the line. 

Judgments about groups would not be as subject to error as Judgments 
about Individuals. A procedure for making Judgments about groups will be 
described later. 

6. Suitable Conditions. 

* 

Ihe pbrase * suitable conditions* in the previous analysis of readiness 
reminds us of the practical considerations that enter into our use of the 
concept. Si^qpose that it would take six months of full-day instruction to 
teach a certain level of child that affirming the consequent is a fallacy. 

We would be tempted to say that he is not ready to learn this fact yet, 
because it would be Just too much trouble. On the other hand, if we could 
teach it to him in fifteen minutes, then we would say that he is ready. 

Hence if we sey that a x>erson is ready to master something, we imply that 
it would not require an iinreasonable amount of effort to teach him. 

Since people will differ on what they consider to be an unreasonable 
amount of effort, an ideal piece of readiness research would enable one 
to predict the results of varying amounts of effort and let each person 
Judge for himself idiether the effort required for a given result is reasonable. 
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But the difficui.ty of performing this task, the production of predictability 
for varying degrees of effort, is great. The current study has attenqpted 
to investigate the results of one given amount of effort, roughly indicated 
as follovs: three veeks of group instruction (size about 20-30) for about 

1K) or 50 minutes per day, such instruction provided by a teacher with 
special training in logic. In a later section we will say more about the 
teaching that we did, but the previous statement suggests some of the 
dimensions of effort and to most people will suggest some that we had to 
ignore . 

Ihe phrase ‘suitable conditions’ refers not only to the amount of 
effort, but also to the nature of the effort. The effort must be of the 
ri^t sort. As a result of this fact, a piece of readiness research like 
the present one is again in a difficult position. How is one to know in 
advance which is the right sort of effort to make? No matter idaat approach 
is tried, if it fails, there is always the possibility that another would 
have succeeded — that they really were ready, if only we had tried a 
different approach. 

The inevitable compromise is to try an approach that seems feasible 
to on e^erienced person \dio knows well the subject matter to be taught, 
or, if time and funds permit, to try several of these. But it must be 
remembered that, following such a course, one can much more easily declare 
that a certain sort of person is ready than that he is not ready. If we 
find that people of that sort do master the thing in question, when pro- 
vided with a given sort of instruction, then we can say that a person of 
that sort is probably ready. On the other hand if we find that people of 
that sort do not master the thing in question, then it is with much less 
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confidence that ve aay that such a person Is not ready^ because there 
mlg^t he another feasible and successful vay of conducting the instruction. 
This is one of those rare cases vhen a positive ansver is easier to give 
than a negative one. 

In the present research we were able to provide at each grade level 
only one set of * suitable conditions'. They were the best we could do, 
given our limits of time and funds. But the results of this readiness 
study apply only to the sorts of conditions that we were able to provide. 

Biis is an important fact about these results. 

7* Summary . 

This analysis of the concepts, readiness ard readiness to master a 
principle, has produced a number of interesting features and some difficulties 
that any readiness study must face. The inference path from a subject's 
behavior to an assertion or denial of his readiness to master a principle 
of logic is a complicated one. Here is a list of the conplications 
discussed above: 

1. The concept is doubly dispositional. 

2. Readiness is an elusive disposition in that once shown, it no 
longer exists. It is explosively dispositional. 

3* Readiness is a practical notion in that the means needed to pro- 
duce the mastery for ^Ich the subject is ready must be feasible. 

k. Since there are possibly other ways of achieving said mastery, 
it is difficult to deny conclusively that a subject is ready for 
the mastery. 

Overlooking the vagueness of 'suitable conditions', briefly -ttie 
proposed analysis is as follows: To say that a subject is ready to master 

principle X is at least to say that he has the disposition, given suitable 
ccndltlonsj to develop the disposition to show, given suitable conditions. 
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the sort of 'behavior that a person ifco has naatered principle X wuld shoy. 



Admittedly the foregoing analysis is circular with respect to the concept 
masteiy, but the focus here has been on readiness. Mastery vas discussed 
in Chapter IV and can be airgued separately. Its analysis is assumed here. 

Any readiness study must simplify by trying to find out Just uhat can 
be acquired by certain sorts of people uhen they are exposed to a certain 
set (or limited number of sets) of conditions. After the research is done 
and the results announced, there is still much cautious Judging to be done. 
!Ehe Inference leap to another person is one that must be undertaken with 
care idien the relevant factors have been examined. Ihe Judgments about 
the feasibility of the means selected must be made. If the subjects used 
did not succeed, then one must consider the question of whether better 
methods might yet be developed. ' 

Hence the results of a readiness study are likely to be rather modest. 

B. THE LITERATURE 

There is practically no literature on the question under considera- 
tion in this chapter. Piaget *s bountiful contributions concern themselves 
only with what children know, not ^at children can learn. The only thing 
that we have been able to find that is relevant is the effort of Hills 
(1961) to see the effect on children in 1st through 3rd grades of a rather 
restricted way of teaching: telling children, \dien giving them a logic test, 
whether each answer is correct before they go on to the next problem. But 
of course Hills* main purpose was other than seeing the effects of teaching 
logic. 

The current study is the first study of readiness to learn logic with 




which we are acquainted. 
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C. PROCEDURES 

!• Assignment of Grade Levels to Class and Conditional Logic; !Pie Pre-Test 

At the beginning of the spring semester, 1964, the pre-test vas ad- 
ministered to all subjects, \dio are described in Chapter III. At grades 
4, 6, 8, 10, and 12, the pre-test vas The Cornell Class Reasoning Test, 
Form X", at grades 5, 7, 9, and 11, "The Cornell Conditional Reasoning 
Test, Form X". These tests are described in Chapter IV. Within a veek 
after the administration of this pretest, formal instruction in either class 
or conditional logic, depending on the grade le \j 1, vas commenced vith the 
UXT's, of vhich there vas one class (size about 20-30) at each of grade 
levels 4 throu^ 12. Class logic vas tau^t to those that took the class 
logic test, and conditional logic to those \rtio took the conditional logic 
test. 

Biis pre-test vas given primarily in order that the scores mig^ht be 
used in the prediction equations. It also did serve as a control in the 
analysis of covariance conparisons; served to alert the LDT*s to the nature 
of the content they vere to learn; but unfortunately also presumably 
served to provide some logic instruction for the control group. 

2. Total Teaching Effort 

Die initial agreement vith the school system called for some member 
of our staff, a person trained in logic and experienced in teaching at the 
grade levels to vhich he vas assigned, to take over each of the LDT classes 
for one period per day for 15 instructional days for the purpose of 
instruction in logic. Each daily period vas to last frcm 4o to 50 minutes, 
naturally minor modifications of this plan vere required to fit specific 
situations, but it vas essentially foUoved. 
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3* The Actual Teaching . 

Each staff teacher vas instructed to teach the logical principles 
in order, using whatever style of teaching seemed to him to be most appropriate 
and going as far dovn the list as he could in the available time. No staff 
member taiic^t more than tvo classes per day, and \dien there were tvo classes 
per day they were in the same type of logic. Thus staff teachers were 
provided with time to plan and to develop written exercises. Each menber of 
cmr teaching staff was also a graduate student at Cornell University. 

The following general procedures^ which are in part based on Cronbach's 
recommendations (195^, p 272), were followed: 

a. Each principle to be taught was made explicit somewhere in 

the course of instruction, though it might have been near the beginning, 
middle, or end of the instruction aimed at that particular principle. 

The language in idildi the principle was stated, and the person 
(teacher or student) by whom it was stated varied from class to class 
and principle to principle. 

b. The use of technical terminology was kept to a minimum, 
but was not colll^>letely avoided. 

c. Sequent written exercises and many examples of varied sorts 
were used. Each staff member was free to develop his own exercises 
and examples, though they tised each other’s ideas. Exas^es of the 
teaching materials will be found in the Appendix. 

d. A modified Euler circle system was used as a model in doing 
class reasoning. 

e. There was no discussion of any items on Ihe Cornell Deduc- 
tion Tests, nor was practice glvto in the specific mode of response 
used in the tests. 
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f* Homework was given in grades 7-12* 

g. Althouj^ students were provided with an evaluation of their 
work, the students were told that their degree of achievement in logic 
did not bear upon any school grades that they were to receive. Biey 
were also told that a record of their progress would be given to their 
teachers and principals. 

h. No attempt mt&b made to counteract the positive effects of 

novelty, notoriety, attention, and whatever else might go into the 
Hhwthome effect. There were two reasons for this: First we were 

trying to find out idiat was possible and took advantage of whatever 
motivation was available. Second, there were disadvantages under 
iidiich our instruction suffered as a result of its not being part of 
the regular school program. Any compensating factors were welcome. 

A rou£^ estimate of the amount of time spent on teaching ea<^ prin- 
ciple at each grade level was atten^>ted by our staff teachers. This is a 
veiy difficult thing to do, since no teacher times himself in this way and 
since much teaching is aimed at more “Uian one thing at a time, furthermore 
we used an Euler circle system for teaching class reasoning, making it 
difficult to allot the time explaining the system to any particular prin- 
ciple. That is, 'tiie tecdmiques of the use of circles in doing class logic 
cpply to all 'Oie principles; hence mucdi of the instruction epplies to all 

of the principles, making class reasoning time allotment someidiat meaningless, 
but not completely so. The principle of the symmetry of exclusion, for 
example, has a corresponding diagram. 

We did feel obligated to give some indication of the differential 
effort given different principles. Educational researdi so frequently 
suffers from a lack of information about teaching that is done. We hope 

er|c 
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TABLE VI-1 



]^rvo1 



Boug^ iwWapMMi EstinateB of the Effort Brvoted to the 
Teaching of Eadi l^inclple at Each Grade Level. 



I^inciple 


Conditional iteaaonine 
Item Group 3 


Graw 

7 


9 


11 


1 


1 


100» 


80 


80 


70 


2 


2 


150 


60 


60 


65 


3 


3 


125 


75 


75 


65 


k 


4 


125 


70 


70 


80 


5 


5 


25 


40 


40 


70 


6 


6 


50 


70 


70 


65 


7 


7 


50 


40 


40 


70 


8 


8 


40 




45 


30 


9 


9 


35 


15 


15 


30 


10 


11 


50 


100 


100 


60 


Cci^ination 


10 & 12 


0 


30 


30 


60 




Class Reasoning 








Principle 


Item Groin? 


4 6 8 


10 


12 




1 


1 


l4o 150 90 


75 


85 




2 


2 


200 225 70 


75 


75 




3 


3 & 4 


l30 150 160 


165 


165 




k 


5 


0 75 65 


70 


75 




5 


6 


4o 75 6o 


70 


70 




6 


7 


40 50 60 


50 


55 




7 


8 


20 25 65 




40 




8 


9 


0 0 120 


120 


120 




Cknohination 


10^U&12 


0 0 120 


120 


120 
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^9ote: Tiaea are given in ttLnutea. *100' atanda for 100 adnutea. 
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that the reader will take this estimated time allotment for what it is: 
a series of very rough and sometimes not very meaningful guesses. If we 
had it to do over, we would probably work entirely with principles of the 
circle method of doing class reasoning rather than with the more elegant, 
but virtually unteachable principles \diich we used. In any case rou^ 
estimates appear in Table VI-1. I. can be seen that the greatest amount 
of effort at the lower grades was devoted to the lower-nunibered principles, 
whereas for the \xpper grades the effort was fairly evenly distributed among 
all the principles. 

These estimates do not add up to the total time spent in the classrocmi 
for a number of reasons. To specify a few: time was spent in organization 
and control of the classroom; some time was not allotted becaiise it was 
used in the teaching of general notions underlying these principles; and 
tiiese allotments are imprecise guesses. 
h. The Post-Test . 

Approximately six weeks after the conclusion of instruction, a post- 
test was administered to al l subjects, those to idiom logic was deliberately 
taufi^t by members of our staff (the LET’s) as well as those to whom it was 
presumed not to be taugbt (the UlET-l's). The post-test was the same test 
that was administered as a pre-test, the class reasoning test to grades k, 

6, 8, 10, and 12; and the conditional reasoning test to grades 5, 7, 9, and 
11. A check was made to see if logic had been taught between test 
administrations to the students to idiom we did not teach logic; no evidence 
of such instruction could be found. 

D. HESULTS 

Bie results of this readiness study are divided into two paxts, one 
dealing w?th the nature and extent of learning of logic that went on in the 

o 
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groiqps to ^Ich ve deliberately taught logic^ and the other dealing vith 
attempts to predict lAiat other students could leara^ given cooparable 
instruction. Each of these parts is concerned vith a readiness question. 

Ihe first part asks %diat the students in this study vare ready to learn 
before ve taught them logid^the second asks '(diat some other students are 
ready to learn. 

1. General Qualifications . 

Pour impoi tant qualifications should be kept in mind as one reads 
this section. First ve vere necessarily vorking vith small nunibers of 
subjects (about 20-30 at each of nine grade levels). The reason for this 
vas that it vas important to vor& intensively^ rather than extensively in 
Ibis study. In particular it vas necessary to make sure that proper logic 
vas tau£^t rather than scmiething else. And it vas desirable to give the 
staff teachers adequate time to plan^ prepare vritten exercises^ and read 
students' papers; they vere pioneeilng the teaching of this subject matter 
at grade levels lover than those at vhidi it is ordinarily taught .. 

As a resuilt of this small number of subjects results are more erratic 
than they presumably othervise vould be. And also in our conparisons 
betveen the LET'S and the lEET-l's some actual differences have inevitably 
failed to reach statistical significance. 

In order to state the other three qualification ve must first dlatinguiah 
among various possible causes of improvement In scores on a test of knowledge 
of logic. Althoue^ these distinctions and the ensuing discussion are 
oversimplified as a result of neglect of interaction between factors, the 
points that result trm the discussion do not suffer therefiram. Hence we 
jpursue the simplified line. 




Possible causes of I m prove m ent in scores are 
l) Deliberate teaching of logic. 
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2) Hhe taking of logic tests \ihich are intended to measure a student *s 
knowledge of logic. Ihere are two features to be distinguished here: 

a) that Vhich results in the learning of logic. 

b) that vhich results in the learning of how to take this 

and/or other tests (test-viseness). 

3) Other school influences. 

4) Influences outside of school. 

5) Maturation that does not depend on contributions from the 
environment. 

Some of “ttiese factors can be introduced at the discretion of the 
school authorities and some are more or less beyond their control. Factors 
1 and 2 can be introduced by the school authorities. Factors 3, 4, and 5 
are increasingly out of their control. 

As a practical matter, uhen we ask idiether a student is ready to learn 
something, we are concerned with the probable resralts of the deliberate 
introduction of factors under our control. Hence we are in this study 
primarily concerned with the effects of factors 1 and 2. 

Since the test-wiseness part of the second factor will give spurious 
results, we would like to discount these. When we simply ask what our students 
learned as a result of teaching and look only at the before and after test 
results, the results of this test-wiseness factor creep in. When we ask, 
however, idiether they have learned more than they otherwise would have, 
and use a ccngsarlscm with a control group to help answer liie question, tiie 
effect of this factor is presumably controlled for to some extent at least. 

With the other part of the second factor, the learning of logic as a 
result of taking the test, the situation is someidiat the opposite. We 
welcome the operation of this factor when we ask what the students have 
learned as a result of teaching (althoue^ its Impact is undetected to the 
extent that it increases the pre-test score). When we use control groups. 
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this factor is controlled for, even tho\agh ve w\ild rather that this not 
happen. After all, our interest is in the learning that occurs as a result 
of lAiat ve do. So the results of the coioparlsons vith the control groins 
mask the results of actually taking the tests, vhich can he standard parts 
of instructional procedures. 

Another source of error is the (^ration of factors 4 and 5 on entire 
classes, both LDT's and INTT-l's. Extraneous occurrences, like a loud 
noise vhile the test vas being taken, the presence of a smart-aleck or two 
in a class, a superior regular teacher Who x>redisposed his class to 
attentiveness and eagerness, the beginning-of-ihe-year assignment of meoft)ers 
to a class on the basis of a criterion Vhich is motivational or related 
to motivational factors, etc., are e^osples. !Ehat such things probably 
occurred and that we had no dieck on them other than alertness and care 
in avoiding them is a weakness of the study. As we will explain later, 
we suspect that some factor of l&ls sort operated to the detriment of the 
Um's in the 9th grade. 

To have provided a statistical check on this sort of thing it would 
have been desiraible to use a number of groups with random assignment as 
UXT's and UIDT-l's. Such a procedure would have been considerably more 
expensive than the one we followed. 

In siamary the general qualifications we have specified are as follows: 

a. ) !Chere were a small nusiber of subjects at each grade level. 

b. ) Test-viseness will result in spurious changes idien the UXT's 

alone are being considered, but will be controlled for in 
conparisons with the UlIT-l's. 

c. ) Learning of logic attributable to the taking of the tests will 

Justifiably have an effect on the WS pre- and post-test 
caqpariscms (thoufi(h som of this effect on change in knowledge 
will be hidden), but unfortunately will be blotted out in the 
eoaparisons with the un)T-l's. 

o 
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d.) Factors affecting total class groiq^s can without detection 
(except for internal consistency evidence) give spuriously 
hifi^ or low scores. 

2. What Did Our Subjects Learn? 

The answer to this question gives an indication of lAiat they were 
ready to learn. Generally speaking^ they did not during the instructional 
period learn much conditional reasoning until the Mpptr secondary levels at 
lAiich tine they made a vast improvement, primarily in avoiding the fallacies. 
On the other hand in class reasoning moderate improvement was registered at 
all* levels with lAiich we worked, except the lowest. These general statements 
need amplification and qualification. 

Conditional Reasoning . 

l) Total Scores . 

The situation in conditional reasoning can be seen in various ways, 
each of idiich enq^aslzes different aspects of the overall situation. First 
let us look at total scores. One can visually compare the mean UXD pre- 
and post-test total scores on the conditional reasoning test as given in 
Table XU -3 in Chapter III. One cannot see much overall improvement until 
Grade 11 where the difference is 17.^ points. This is a rou^^ unsophisticated 
comparison, but it has its merits. 

One can also conpare W£*a with the L1IDT-I*s on the post test, taking 

into account differences in the pre-test and IQ. The results of such a 

comparison are summarized in Table VI-2. The figures are presented in detail 
in Table A-5 in the Appendix. These couparlsons show that in grades 3 nnd 7 
theM is no statistically significant superiority one way or the other. In 
grade 9 there is a statistically significant superiority favoring the students 
who were not taue^t logic, and in grade 11 there was a greater superiori'^ 
favoring the students who were taught logic. The siperlority of the taught 

nth graders is quite striklag, with a difference of 15*2 points in adjusted 

Q means on the post-test. (The superiority is 22.2 points before the means are 

ERIC 
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.adjusted. ) 

!Ehe situation in grade 9 is puzzling. Not only did the control group 
have a significantly higher adjusted mean, hut the mean score (unadjusted) 
of the tau^t 9th graders vas actually lower (2.6 points) on the post-test 
than it was on the pre-test. Possible explanations that have occurred to 
us are the following: First, it mi^t be that at this level teaching is 

just beginning to take hold, but just enou^ to be confusing. That is, it 
mi^t be that at lower levels, people work on the basis of "feel" only and 
that at this level the teaching that has occurred has been effective enough 
to interfere with the "feel" method of judging arguments, but not effective 
enough to provide a reliable replacement. 

A second possible explanation is that the particular specimen of 
teaching was simply confusing. A third possibility is that the problem 
lies with the students themselves. It mi^t be that there was an Important 
difference between the two groups which did not show on any of the measures 
that we used. We do know that the 9th graders \diom we tauc^t were alleged 
to be of high enough ability to be taking algebra, but for some reason or 
other were not doing so. Our staff teacher reported that they did not care 
•idiether they learned logic. It might have been a problem class. We tend 
to favor this the third explanation, >diich, if the proper one, makes suspect 
the findings about conditional reasoning ,^t the 9th grade level. It was 
only at this level that such motivational problems were reported by meidbers 
of our staff. 

2) Cosqjonent Scores . 

As can be seen in Table VI-2 the situation is roughly the same as 




viewed llirou^ the component scores. The ll’Ui grade group that was taufi^t 
conditional reasoning did significantly better on all three of the coaponents 
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TABLE VI-2* Statistically Significant Post-Test Differences Between 
Students Who Were Taught Logic and Students Who Were Not 
Tauc^t Logic, Using Analysis of Covariance with Pre-Test 
and I.Q. as Covariates. 



Grade 

(uniT-1 


Conditional Beasoning 
5 7 9 11 

27 24 17 26 

26 25 23 22 


4 

25 

22 


Class 

6 

25 

34 


Reasoning 
8 10 

27 22 

24 18 


12 

23 

17 


Total Score 


- 


W 


R 


- 


R 


- 


- 


R 


Coaponent 


CP 


- 


w 


R 


- 


R 


m 


- 


- 


SY 


- 


- 


R 


- 


R 


R 


- 


R 


SU 


- 


- 


R 


- 


- 


- 


- 


- 


Item Groip 


1 


- 


- 


- 


- 


- 


- 


- 


- 


2 


- 


- 


R 


- 


- 


- 


- 


- 


3 


R 


M* 


R 


- 


- 


- 


- 


- 


U 


- 


- 


R 


m 


R 


- 


- 


- 


5 


- 


w 


- 


- 


- 


R 


- 


R 


6 


- 


w 


R 


- 


- 


R 


- 


- 


7 


- 


- 


R 


- 


- 


- 


- 


- 


8 


- 


- 


tm 


- 


- 


R 


- 


- 


9 




- 


- 


- 


- 


«* 


- 


- 


10 


- 


R 


- 


- 


- 


- 


- 


- 


11 


- 


W 


- 


- 


- 


- 


- 


- 


12 




mm 

evxiTj 


R 


- 


R 


R 


- 


R 
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ferenee favoring the group that vas taught logic. The ayi^l 'V* 
is used to indicate a statistically significant difference favoring 
the group that vas not taufi^t logic. A dash is used to indicate lack 
of statistical significance. The yft level vas used tfarou^^ioiit. 

A mrd of caution: The sixteen conparisons described in aqy one 
colian above are statistically dependent. 
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built into the test. Ihls did not happen at any of the other grade levels^ * 
and at the 9th grade level on the concrete familiar component there is another 
reversal. 

3) Item Group Scores . 

Ihe great superiority of the Uth graders vho vere taught over those 
uho vere not taught seems to lie mainly in the fallacies^ but also in 
contraposition^ basic and practical^ and perhaps with alfirming-the- 
antecedent items, ^y 'basic contraposition* ve mean the valid move from 
'If p, then q* to 'If not q' then not p'. By 'practical contraposition* 
ve mean the valid move ffom 'If p, then q* and the denial of 'q* to the 
denial of *p*. The former appears as Principle 6 and Item Groiq) 6. The 
latter^ vhich ve have also called 'denying the consequent* (Chapter II ), 
appears as Principle 4 and Item Group 4. The tvo forms are logically similar, 
as can be seen by saying them over to oneself. 

The four fallacy item groups (2,3^7> and 12) and the tvo contra- 
position item groups (4 and 6) stand out uniquely on the covariance 
comparison. On all of these item gro\q>s, but only these item groups, are 
the Uth cpraders that ve tauc^t significantly better than the ones ve did 
not teach. This finding is pexhaps the most striking one of this study. 

It also comes through in Tables /—7 and A-8 in the Appendix, vhich 
'give item group pre- and post-test measures on the groups to vhich ve tau^^t 
logic. A portion of those tables is presented in Table VI-3, vhich shows 
^Oie difference between pre- and post- test measrires for each item group in 
the U1& grade. The measures are mean difficully indices, percentages 
meeting -the sufficient condition, and percentages failing to meet the 
necessary condition. As can readily be seen, these six i*tem groiq>s stand 
out, and -the fallacy item groups stand out most srlkingly. 
o 
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TABLE VI-3. Conditional Reasoning Pre- and Post Differences for 11th 
Graders to Whom Logic Was Deliberately Taught. 



P55 — 

Item 

Group 


Inqprovement in 
Mean Difficulty 
Indices 


In^rovement in 
Percentage Meeting 
the Sufficient 
Condition 


Increase in 
Percentage Failing 
to Meet the Neces- 
sary Condition* 


1 


9 


15 


- 8 


m IV 


50 


65 


-6l 


3** 


53 


73 


-69 




11 


27 


- 8 


5 


k 


2 


- 8 




19 


39 


-19 


7^Ht• 


27 


h2 


-35 


8 


- 8 


-11 


15 


9 


-13 


-15 


8 


10 


3 


8 


k 


11 


- 1 


0 


k 


12«* 




50 


-65 



*A negative nuinber here indicates a reduction in those failing to meet 
the necessary condition and thus shovs an improvement. 

♦•KBie fallacy item groiqps are marked by a double asterisk. 

••HHKHie contrapos-^ ion item groups are marked by a triple asterisk. 

Bote: Biis table is taken from Thbles A-7 and A-8 in the Appendix, 

^ich present the pre- and post-test scores and differences for 
all grade levels to vhich conditional reasoning vas taught. 
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On the other hand there is arong the students taught logic a sli^t 
worsening on the ’only-if * item groxqps, nunibered 8 and 9. Perhaps the 
word *only* was previously quite clear, but that ifcat they were tau^t about 
the word *if by itself confused their understanding of 'only if. A 
reference to Table VI-1 shows that about an hour was spent teaching the 
'only-if principles. Perhaps this amount of time was insufficient. 

It is interesting to note that there was no improvement on the 'if-and- 
only-if ' item group (numbered 11), even thou^ about an hour was devoted 
to this concept. Perhaps again the distinction between 'if and 'only if 
was confused. 

There is sli^t in5>rovement on the transitivity item groups, numbered 

5 find 10, but one does not know idiether this represents a real is^rovement 

or not. There is a greater improvement on the most basic move of all, the 

affirmation of the antecedent (represented by Item Gferoup l), but not enou^ 

to reach statistical significance in the coapariscn with the students not 

taught logic. At all grade levels, however, there is a lack of a really 

striking teaching- >^6U£«:d in^rovement on this, the most basic conditional 

reasoning principle. Ohis is shown in Table VI-4, and is also suggested 

by the lack of statistical significance of the post-test differences 

between the IJDT's and the UIET-1 'e, which lack can be noted in Thble VI-2. 

TABLE VI-4. Conditional Beasoning Pre- and Post-Test Differences for 
Principle #1, the Affirmation-of-the-Antecedent Principle. 



Grade 


N 


Improvement in 
Mean Difficulty 
Indices 


Improvement in 
Percentage Meeting 
the Sufficient 
Condition 


Increase in 
Percentage Flailing 
to Meet the neces- 
sary Condition* 


5 


27 


9 


15 


18 


7 


24 


7 


5 


- 4 


9 


17 


4 


0 


-12 



n 26 9 15 



- 8 



* A negative nunfcer here indicates a reduction la 

the necessary condition and thus shows an improvement. 
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Suamary and Possible Import for Teacfa^iie * 

In sumoaxy ve appear to have been able to teach iqpper secondary stu- 
dents to avoid the basic fallacies and to some extent to recognize basic 
and practical contraposition as valid moves in conditional reasoning* In so 
doing, however, we mi^t have interferred with their grasp of the basic 
valid moves from *only_if ' sentences. We seem to have had little effect 
on their grasp of the transitivity of the if-than relationship. At this 



level, as well as at earlier levels, the teaching mig^t have had some 
positive effect on knowledge of the most basic conditional reasoning move, 
affirmation of the antecedent, but, if so, the effect was small and not 
statistically significant. Since affirmation of the antecedent is in a way 
a transitivity principle (the affirmation carries through from the antecedent 
to the consequent), these results fit together. 

Die most striking fact about the results of this teaching was its 
great effectiveness on total score at the tpper secondary level, as contrasted 
with its either negative effect or lack of effect at lower levels. At some 

future time, the location and sharpness of the iiplied dividing line diould 
be investigated. 



Die sufficient condition percentages suggest rather strongly that the 
basic principles of conditional reasoning can be pretly well mastered, by 
the vpper secondary level - at least for students like those in this study, 
but liiat there is not imudi point in trying to teach conditional logic in 
elementary and lower secondary Fiirthermore these results suggest tiiat the 
things that can be taught are the fallacies, contraposition to some extent, 
and perhaps ■Uie validi*ty of affirmation of the antecedent, mig^t 

partly teachable, but also seems to develop on its own without deliberate 



teaching. 




♦ Incidentally this sentence and others that refer to secondary, etc., 

are deliberately sooe^diat vague because of the difficulty of any 

kind of line on the basis of these results alone. In particular we want to 
avoid placing the graders on either side of a line,beeause of doid>t8 
about the motivation of the 9th grade ISf's. 
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That tranaitivity and the valid movea vlth 'only If- seemed to develop 
on their osn and that dcliterate teaching did not help at the levels with 
i*lch ve aorked is suggested by the lack of improvement in percentages 
meeting the sufficient condition during the teaching period at all grade 
levels , together with the percentages that have mastered 1*em in the 11th 
grade on the pre-test: 8l, 8l, 88, and 96 respectively on Item Grot^-s 5, 10, 
8, and 9 . These figures can be found in Table A-8 in the Appendix.* 

5 ) learnin g Words vs. Learning logic . 

An Intriguing question is that of Pettier ttie great is^rovement 
registered in the four fallacy item groins represented greater understanding 
of logic, or Aether it represented a grasp of the meaning of the aord -if- 
as it is properly used. It might be argued that the use of the wrd -if • 
is cemaonly taken to Imply Aat is properly meant by 'if and only if-, or 
in other vords «jat -if- is taken to Introduce a necessary as veil as 
sufficient condition. Bie suggestion then is that se did not liqmjve their 
knowledge of logic; ve only Aanged their vocabulary. 



*. ^ P®a®Tble objection to this claim about the teachability of transitlvitv 
h! 5th grade staff tea^r es^lTSS 

tte ^le application of the affirmation of the antecSt ^Sple V 

a^cedentn^lrt c?* *tansit1vity principle and the afflimation'of the 
principle. Since our instructor reported spending no time on 

particular coaiblMtion iTnot 
teachable at -ttie lower grade levels, one mlg^t ask. 

of “ effort vas made to teach the affirmtion 

tiot^LM** l^'tple and the transitivity principle, but it had no 

conclude that the coaibinatlon of one with another 
itself vould not have been effectively tau^t at the loser grade 




This is an extremely puzzling issue. Ab Benjamin Lee IQiorf has 
pointed out, our language, our conceptual structure, and our power to 
think are intimately related. But it does make sense to suggest that the 
distinction that we represent by the words 'if and *if and only if was 
already known to our subjects (even though they do not use these words to 
represent it) and that they used 'if to mean what we mean by 'if and only 
if. Thus even if there is an intimate relationship, there is also a 
meaningful question. 

If this verbal interpretation of the learning that went on is accepted, 
then the learning has less significance than otherwise siqposed. Under 
this interpretation we were not teaching the students to think; we were 
teaching them a common vocabulary. Row this is important too — in order 
to facilitate communication in the making of crucial distinctions — but 
it is not as important as teaching them to think more clearly. 

This verbal interpretation is consistent with what happened with 
‘b:^sltivi‘ty, 'fdiich seems to be not sinply a verbal matter, but also e 
conceptual one. The hypothesis that we were teaching them the meanings of 
words allows that there would not be much learning of transitivily. But 
the learning of contraposition and idiat there was of affirming the antecedent 
is contrary to the verbal hypothesis, because these things seem to be clearly 
conceptual, and not sinq>j|^ verbal. The counter-effect of this latter evidence 
mic^t be explained away be the suggestion that for these things they learned 
a few rules by rote and did not understand them. 

As one can readily see, the question bears further investigation, 
b. Class Beasonlig . 

The situation in class reasoning is rather different from that in 
conditional reasoning. The dividing line, if there is one, comes in the 
\9per elementary levels, sosMUhere around age 12; but that there is a line 



is not clear. The teaching of class reasoning did not have effect on 
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the Uth graders^ but generally had a positive effect on those tram 6th grade 
up to 12th grode. This effect ie not neorly as striking as the effect 

of teaching conditional raasoning to the Uth graders. 

1) Total Scores . 

The change in mean total scores for the IXXD's over the interval between 
pre-test and post-test is positive in grades 6, 8, 10^ and 12, but not in 
grade 4. This can be seen in Table III-3 in Chapter III. The lioprovenients 
registered are 9*5^ 3*8, 8.3, and 6.8 respectively. These are considerably 
smaller than the Improvement of 17.0 points registered by the Uth graders 
on conditional reasoning. 

In a post-test conparison with the UIDT-l’s, holding IQ and pre-test 
constant, the LDT's in class reasoning were significantly superior in grades 
6 and 12, but not in the other grades, given the degree of refinement of our 
experimental procedures. This is shown in Table VI-2. 

2) CoBgxinent Scores . 

Ihe situation is generally the same when scores are broken down into 
their components. As indicated on Table VI-2, there is some statistically 
significant superiority of the IDT's at grades 6 and 12, and also at grade 
8. Ciis happens most frequently in the synibolic component. Since in the 
teadiing frequent use was made of such phraseology as 'All A's are B's',* 
this difference in the synibolic component is understandable. It is perhaps 
noteworthy that only in the 6th grade were the LDT's statistically signifi- 
cantly siperior on two of the cooponents. In no grade was this the case for 
three components. In grades 8 and 12, it was for one component only, the 
synibolic conponent. 

« 




The letters at the end of the alphabet (e.g., 'X' and 'Y') were rised in 
the test, not the ones at the beginning, whicdi were used in teaching. 



3) Item Orem Scoree . 

In *016 class reasoning item groups there is nothing that compares vith 
the remarkable improvement made by the Uth graders on the conditional 
3reasoning fallacy item groups. The moderate general overall Improvement 
trm grade 6 onvord, vhen instruction is given> ' can be seen in Tables A-9 
and A-10 in the Appendix. As can be seen in Table VI-2, for one item 
group, #12, there was a statistically significant superiosrity, IQ and pre- 
test item-group score held constant, at three grade levels on the post-test. 
This item group embodies the most complicated logical structure on the test. 
Perhaps the instruction vas fairly successful in providing an orderly uay 
of dealing with coo^lex arguments. 

Exceptions to this general overall ioqprovement during the period of 
tea<diing are Item Groups 1, 10, and 11. Let us discuss them. 

Item Grov^ 1 is a special kind of item group in that it is so basic: 
it tests for the meaning of *all' and negation. It calls tqpon someone to 
judge that a statement of the form, 'At least some A's are not B's', is 
inconclstent vith the corresponding statement of the form, 'All A's are B's.' 

To some extent this item groi^ is a test of whether the subject understands 
vhat is requested of him on the test, because presumably people at these 
levels are fairly veil acquainted vith the meaning of 'all' and of simple 
negation. So ve are not surprised by the lack of improvement under instruc- 
tion on this item group. 

The lack of isproveisent under instruction for Item (hoips 10 and 11 is 
somevhat puzzling. Item Groip 10 calls for the comiblnatlon of the transitivity 
and contraposition principles. Simple transitivity is tested for in Item 
Groiqp 2 and basic contraposition is tested for an Item Group 9* There vas 
some Improvement in each of these, and according to hypothesis abovc^ there 
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¥88 iiBprovenent In ability to deal with cooiblnatlone. So there ia 
aone'ttiisg of a puzsle* Bowever^ the pre- and post- test differences on 
Item Groups 2 and 9, the basic transitivity and contraposition Item groins, 
are not large enoue^ to make the problem serious. When the study is 
replicated with more subjects^ one can see If the problem arises again. 

It Is similar with the lack of improvement In Item Group 11, ¥hich 
calls for the double application of the transitivity principle. The single 
application of the transitivity principle is tested for by Item Group 2, and 
ttiere is general inprovement after teaching on that item group. But again 

the improvements are fairly small, so it is not fully clear that there is 
a puzzle. 

k) Suamaiy . 

There is nothing striking about the effects of teaching clcuss reasoning. 
Qiere appears to be moderate and fairly general Improvement in groups frcm 
age 12 onward. Two things that stand out slightly are the inprovement in 
handling coaplexlty represented by Item Group 12 and isprovement on the 
symbolic component. 

^^^^laMtions of the Differences Between Conditional and Class 

Inevitably one wants to try to ej^lain "ttie differences that we found 
between the score patterns on the conditional reasoning test and those on 
the class reasoning test. Wiy Ibe striking isprovement in the inb gra^ 
on the conditional reasoning test and the only moderate laprovement from 
grade 6 upward on the class reasoning test? Why was there such a contract 

between the improvements on the fallacy item groips? We can only speculate 
at this time. 

A possible eagplanation of the general situation is that since class 
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reasoning Is easier, the students on the class reasoning tests had less 
possibility of inprovement. Ihis explanation has the veakness of not 
explaining i<iy in cases ^ere there does seen to have been room for con- 
siderable improvement, there vas still not an improvement comparable to 
that registered in conditional reasoning* Ifeny such cases can be found in 
Tables A-9 and A-10 in the Appendix. Jbr example in Table A-9 one can see 
that for Item Gro\q> 3, trtiich is a conversion fallacy gro\:p, althou^ the 
mean difficulty indices on the pre-test were 3^^ 51, and 71 in grades k, 

6, 8, and 10 respectively, the improvements were only 4, 11, 21, and 13 . 

A second possible explanation is that in the conditional-reasoning 
fallacy item groups, a great share of the learning was of the sufficient- 
condition meaning of the word *if*, as opposed to the necessary-and- 
sufficient-condition interpretation. Since there was no corresponding 
verbal learning for the class reasoning test, the improvement was less, the 
explanation holds, although the amount of actual improvement in knowledge 
of logic was about the same. 

A difficulty with this explanation is that it does not tell why this 
verbal learning did not occur before the 11th grade. It mi^t be urged 
that if the learning is of a new meaning for a word, one would expect 7th 
and even 5th graders to be able to do it. This challenge to the explanation 
of course has no evidence to offer that a new meaning for this word, *if *, 
could be grasped at such an early level. So the question is unresolved, and 
more research should be done. 

Ohe attenpt to answer this question is based on the development of 
multiple regression equations into idiich one can introduce values of cer- 
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tain variables and produce a predicted score. Two sets of these equations 
were prepared; one made use only of information uhich is generally available 



in school records; the other in addition made use of pre-test scores. 

In the preparation of these equations, all LDT's uho took a given 
logic test vere groiqped together. Hence grades 5, 7, 9, and 11 were 
combined, as were grades k, 6, 8, 10, and 12. Equations were prepared for 
total score, the three component scores, and the twelve item-groiq) scores. 
Since there are two tests, and since there was a set of values prepared 
that made use of pre-test scores as well as one which did not, there are 6k 
equations altogether (( 1 + 3 + 12 ) X 2 X 2 ). A cross-validation estimate was 
coapxted for each equation. Ohe non-variable values that go into these 
equations appear in the Appendix, Tbbles A-11, A-12, A-13, and A-llf. 

given in those tables btc the factors by which one must 
multiply the scores that are introduced into the equation. Ihese products 
together with the given constant are simmed to give the predicted score. 

Here is an exasqple of an atteoq)t to predict a score on Item Group k on the 
conditional reasoning test: 

8* . wi AummLLC or 'cne unm nr m Tim tOT H Blf l n ff A 



^ 3 B p«Ple of the Use of a Multiple B emsaion 
Lctlon. 



Assume Ihe fbllowing values of the variables, whldi values are the 
mean values for the 11 th grade LD!P*s: 

Qrade: 11 

Chronological Age: 199.8 months 
IQ: 116.0 

Socio-Economic Index: 3.5 
Sex: 1.5 (male-l; female»2) 

IDotal Score on pre-test: 63.7 

Pfe-test score on this item groiq? (#4 here); k.26 
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Ccjmbining these figures with the weights and constant given in 
Table A-11^ one has the following equation: 

Predicted score * (-.001) (ll) + (.007i^) (199.8) + (.0064) 
(116.0) + (-.127) (3.5) + (.423) (1.5) + (.0384) (63.7) + 
(.314) (4.26) - 1.26 = -.01 + 1.48 + .74 - .45 + .63 + 2.44 
+ 1.34 - 1.26 » 4.91^ predicted score . 

Ihis figure^ 4.91, can be rounded or not, depending on what one is 
going to do with it. 

b. Making Use of the Generated Predictions . 

Naturally the utility of such predictions depends on the multiple 
correlation coefficients and the cross validation. Biese figures, together 
with the standard errors are given in Table VI-5. Given our primaiy 
interest in predicting mastery of the principles of logic, the corresponding 
multiple correlations and estimated cross validations are not hi£^ enough to 
warrant predictions of individual item group scores. But predictions for 
groups seem possible. Inserting the mean scores for a group enables one 
to generate a predicted mean score for the group. 

But we would like to go further. We would like to make a rough pre- 
diction of the size of the percentage of the group who, after conparable 
instruction, will have mastered the principle. Given the operational 
definitions set forth in Chapter IV, the interest is in roughly predicting 
the percentage who will meet the sufficient condition for masteiy — getting 
at least five correct out of the six items in the item groi® that corres- 
ponds to the principle. One cannot assume a normal distribution around the 
predicted mean, particularly idien it is 4 or better, as one can see firm 
working out a few cosgiarlsons between the mean difficulty indices and these 

percentages as they actually occurred on the testii^ that was done. 
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TABLE VI- 5 . Iftiltlple Correlations^ Cross Validation Estimates, and 
Standard Errors for Prediction Equations. 
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Bote: Cross validation ind|ees estimated by means of the Lord-IUcholson 
foraula. (Brogden, i 95 ^ipp 3 T 7 ~hOO) 

Bi Is the multiple (Kjarrelatlon 

Bxv is the cross validation estimate 

Is the standard error. 
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So ve plotted each mean difficulty Index against each percentage 
meeting the sufficient condition on the pre- and post-tests for each of the 
two types of reasoning studied. Ihese plotted points are reproduced In the 
Appendix as Graphs A-1 and A-3* A line of best fit was derived from these 
graphs and appears In Graph VI-1 in this chapter. A similar process was 
carried out for the percentages failing to meet the necessary conditions. 

See Graphs A-2 and A-4 in the Appendix. Ihe line of best fit thus derived 
also appears on Graph VI -1. 

Now we are in a position to con 5 >lete the treatment of the example. 

Taking the predicted score of 4.91 we divide by 6 in order to secure the 
corresponding mean difficulty index. In this case it comes out 825^. 

Tracing this value up through two intersections, we obtain predicted 
percentages of 13^ and 72j. The former is the percentage predicted to 
fail to meet the necessary condition and the latter is the percentage 
predicted to meet the sufficient condition. In other words we predict that 
someidiere around 72^ of the students in our hypothetical case will have 
mastered Conditional Principle #4 and that somewhere around 13^ will 
definitely not have mastered it. Incidentally the actual percentages for 
the nth grade LDT’s were 155^ and 77^ on the post-test. 

Making use of the previous analysis of readiness for mastery and 
accepting the limitation imposed by our being able to provide only a given 
amount of a given cost of instruction, we can now exeo^lify the type of 
statement that we would like to make about the readiness of the members of 
a group to master a given principle of logic. Let us assume that these 
statements are to be made about the 11th grade U3T*s before they received 
any deliberate Instruction. What we want to do is to estimate the percentages 
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GBAFH Vl-1. Qi^irlcolly Derived RelatlonshlpE Between Mean Difficulty 

Indices and the Percentages Meeting the Sufficient Condition 
and Falling to Meet the Necessary Condition. 




Mean Difficulty Indices 



1*0 are reafly to naater a given principle (aay Principle k) and vho are 
not ready. 

Beferrlng to Table A-8 in the Appendix we see that the pre-teat ahova 
that at leaet 50^ of the students have already mastered Principle k and 
at leaat 23^ have not maatered it. Biis foUow ftoai the fact that 50)( 
net the sufficient condition and 23# failed to meet the necesaaiy condition. 
About the remaining 2T3t no Judgment is made. 

How we have predicted that after Instruction the percentages will be 
72# and 13 #, for an Increase of 22 percentage points and a reduction of 10 
percentage points respectively. So we con say the following: 

1. Since 50^ hove already mastered the principle, the question of 
their readiness does not arise. 

2. At least 22# are ready to master the principle. 

3 * At least 13# are not ready to master “Uie principle. 

4. We do not want to be comultted about the readineaa of the 
other 15#. (100 -50 -22 -I3 * I5) 

Several qualifications need to be made, but for Illustrative purposes 
we made the specific unqualified statements given above. Obviously with 
a groiq» of the size of the Uth grade LDT's (H^) one would not want to 
Imply such precision. More rounding should occur. And such words as 
•probably* and 'approximately' should be introduced. 

Hiis procedure for estimating the per cent of students who are ready 
to master a given principle is novel, and we do not know a way to eatlmrte 
a confidence interval. Oia distribution is not normal. We can at this time 
only say that this procedure gives the best estimate that we can make on the 
basis of the data we have. The development of procedures fOr estimatii^ 
a confidence interval is a task to whldi study needs to be given. 
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It should be noted that the procedure is based upon students uho 
have taken the pre-test and thus have had the benefit of whatever learning 
accrues theref^rom. If ttie equations without pre-test values are used, it 
should be kept in mind that part of the instruction given to those students 
was in the form of the administration of the pre-test, 
c. Sunmary and Overview . 

We have developed a method for making statements about the percentages 
of a groiqj idio are ready to master a principle and tdio are not ready. When 
pre-test scores ore not available, the sufficient condition statements must 
be about percentages vho either have mastered the principle or are ready to 
do so. The necessary condition statements would not be altered by the lack 
of these scores. One would still talk of the percentage idio are not steady* 
These equations can also be used to predict groig) mean total component 
scores. This is a more traditional use of such equations. The trouble is 
that there is as yet little operational interpretation of such scores. 
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The entire e^rimsnt should be replicated, but with more classes at 
each grade level to minimize the effect of class-wide factors. The intensive 
treatment used in this study leaves the results open to influence by 
idiosyncracies in the treatment. Furthermore the equations diould be 
checked with students in other environments and witii 'ttiose in grades between 
those idiich were used in this study. The dividing line, if it exists, 
beyond ihich conditional reasoning can be effectively tai^t diould be 
located more definitely. 



Research of this sort diould also be extended to lower ages and an 
atteqrt should be made to increase the amount of time devoted to 
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logic in order to see rtiether that wuld make much difference at the 
varioua age levels, tte length of teaching time could also be used aa a 
variable in the aniltlple regression equations. 

ihe testa should be given on a pre- and/or post-test basis at varioua 
levels. Including college, in order to develop a greater understanding of 
the meaning of predicted total and component scores. 

AKrther set of multiple regression equations mlglit be developed, 

■eking use of personality variables. Ihese have been neglected in this study. 

ae possible anomalies betueen the clase reasoning combination item 
groins 10 and U and the Item groups representing their parts diould be 
investlgmted and resolved if possible. One vonders Shy vhen there Is 

ap~vement In the parts (and In ability to combine parts), there Is not 
an ioproveuent in the vhole. 

UM and perhaps most Isqwrtant, the posslbilily that verbal aa opposed 
to conceptual learning accounts for the marked condltional-reasoning 
taproveswit among Utti graders must be Investigated. This probleai will 
require soifcisticated indirect investigation. 

F. CEAFXER SOMAHT. 

ate first part of this chapter vas devoted to an analysis of the 
*““***' Sgainess to master a principle. It was noted that the double 
dlsposltlonallly of tiie concept makes It difficult to Justify 

statements that make use of the concept. Another source of dlfflcul'^ Is 
its explosive-type dispositionality. 

Bie result of the analysis goes rou^ly as foUous: To eay that Y 
is rea4y to aaster Principle X is to s^ that Y has the disposition, given 
suitable conditions, to develop the disposition to show, given suitable 

conditions, the sort of behavior tiiat 
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wuld show. Fop slnpliclty’B sake there is a circularity In the use of 
the term 'oastezy* to define 'readiness for nasteiy*, birt this is resolved 
for present purposes by appeal to the operational definition of 'mastery' 
given la Chapter IV. •She vagueaeas of the phrase 'suitable conditions' 
is unavoidable. Bie concept is vague in this respect. 

After noting the dearth of literature dealing vlth the topic, capacity 
to learn logic, we described our experimental procedures, and said vhat ue 
could about the nature of the teaching that vas done. 

Discussion of the results vas broken up into two parts, the latter of 
idilch was the more speculative, because it attempts to make present-tense 
readiness statements. Ihe first part vas concerned with vhat our stibjects 
actually did learn ‘tdiile under instruction. Ihus it was essentially a 
discussion of their prior readiness for mastery and in effect made past- 
tense r eadiness statements. 

!Ehere was a marked contrast between the learning of conditional 
reMonlng that was effected and Ihe learning of class reasoning. Ihere was 
practically no learning of conditional reasoning in grades 5, 7, and 9; 
but in grade 11 Ihere was a vast improvement. Oils impi'ovement was con- 
centrated mainly among Ihe fallacy item gzoigps, but also to some extent in 
those presenting contraposition and arTlrming the antecedent. Ibr class 
reasoning on the other band there were small, amounts of ispvovemant from 
grade 6 onward, the largest Impro v em e nt under Instraetion beli« registered 
with the most coaplex items. Ohis latter Impr ov em en t perhaps indicates the 
efficacy of ^e instruction in handling and <nFderlng con^ilexities. Im- 
provement in handling symhollc items was also noted. 







One possible explanation of the marked difference betveen conditional 
and class reasoning is that the major learning that accounts for the t«st 
improvement in conditional reasoning iias the learning of the sufficient- 
condition meaning of the vord 'if S uhich has no analogue in class reasoning* 
One difficulty vlth this explanation is that it leaves one uondering uhy 
the meaning of ihis word vas not effectively taught in grades $, 7, and 9* 

On the basis of these resiats it seems that, given conparable students, 
class reasoning instruction might profitably be coonenced at about age 12, 
and that conditional reasoning instruction mi^t be commenced by age l6, 

possibly sooner. It vas rou^tOy at these ages that ve found readiness for 
greater percentages of mastexy. 

The attenqpts to make present-tense statements about readiness for 
mastery of particular principles of logic vere based iqpon the development 
of multiple regression equations idiich made use of the variables, grade, 
chronological age, IQ, socio-economic-status, and sex; and in addition the 
optional use of pre-test scores. Ihe predicted scores are not reliable 
enough for use in individual cases, but a scheme vas developed for making 
predictlOT. Of percentages of groups, ffiese predictions, assuadng the previous 
analysis of ’readiness to master Principle X’, become statements about 
percentages lAo are ready to master tije principle and eho are not retehr to 
master Ihe principle. Ihese statements about percentages assvne coa^areble 
teaching treatment and thus the readiness statements generated are oveiprectse. 

Bie major ueakness of this study lies in the smaU nmiber of subjects 
*lth uhiCh «e wrked (about ao-30 per grade level, vlth only fc or 5 grade 
levels fbr each type of reasoning). B>is smallness vas made necessary by 
tte requirement that the treatment be intensive: lhat Ihe Instruction be 

“Wled out by people rtu. taev logic, vbo taev hov to teach at ihe level 

atslgned and ifco had adequate time fop class 
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ju'eparation and evaluation* 



Chapter VII - Ihe Fast and Future of the Project 



Although no date can be given to nark the beginning of the Cornell 
Critical Blinking Project, since it Just grew Topsy-llke, several events 
early *ln Its existence can be dated. Two general critical thinking tests 
:rere prepared in 1961. A tentative theoretical grounding of the project 

was published in 19^ and has been under constant revision since then. 

/ 

A set of Short reviews of works related to critical thinking was prepared 
and made available in 1962. Biese reviews were supported in part by a grant 
of the Ford Foundation to the Cornell Junior High School Project. In 
addition funds ffom the same source were used to pay for a collection of 
works related to critical thinking and a set of specimens of every critical 
thinking test that we could find. These two collections proved very helpful 
as research has progressed. 

The Readiness Study; The Pest . 

In academic year 196I-I962 the Cooperative Researdi ^anch of the 
U.S. Office of Education gave a grant to Cornell to study critical thinking 
readiness. That grant, which ran from May, 1962, to Septe^er, 1964, supported 
the research reported on here. It was felt that a readiness study would 
involve some of the basic work necessary before applied curriculum and 
method studies could be performed. This basic work included clarification 
of aspects of critical thinking, development of tests for aspects of 
critical thinking, and rough determination of the Imowledge of, and capacity 
for learning aspects of critical thinking found in students of various levels. 

The initial intent under this grant was to pick two asj^cts of 
critical thinking, probably deduction and asuunqption-findlng, anf perform 
the above-indicated basic work for each at all the levels of elementary 
and secondary school. We started with deduction, feeling that it, of 
all aspects of critical tiilnking, was the one most fully developed, and 
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would be the easiest to handle. We hoped to make the study of deduction 
both a pilot study for the other aspects of critical thinking and a 
study of deduction in its own right. 

As soon as we came to a detailed consideration of the nature and 
principles of deduction, we discovered not only that it as a field has not 
been conqprehensively defined and categorized, but that the parts that have 
been worked on by logicians are not by any means clear and uncontroversial. 
We had to select among possible types of deduction and had to select within 
■types. The content in the field of logic not being as well worked out as 
we expected, we had to devote a great deal of time to this Job. 

Although our original intent had been to teadi the basic principles 
of deduction at each grade level, we discovered as a result of our analysis 
of logic that this would be too much to teach in the limited amount of time 
we were able to get the school system to comnit to us, so we set about to 
find delimited parts of logic to teach. Ohe plan became one of working on 
only one particular type of logic at each grade level. 5br the first and 
pilot year, we picked for study sentence reasoning, class reasoning, and 
ordinal reasoning. These are described in Chapter II. 

Because of item and test tryout experience we assigned ordinal 
reasoning to the elementary grades only, since by the middle of the secondary 
school experience, most of the students ^om we interviewed had already 
fairly wen mastered the basic principles of ordlaal reasoning under the 
present natural-cultural system. Ihere seemed not much point to ask what 
basic principles of ordinal reasoning secondary students are ready to 
naster Kisa they have already generally mastered these principles. 
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During the first and pilot year of the study ordinal reasoning was 
studied in grades 1, 3, and 6; sentence reasoning in grades 2, 5> If 9f 
and 11; and class reasoning in grades 1> U, 6, 8, 10, and 12. After extensive 
item and test tryouts, one test for each of the three types of reasoning 
was developed. It was used as a pre-test and a post-test for three typical 
classes at each grade level. Shortened versions and special techniques 

were used at the lower grade levels. 

One of the three classes at each grade level was selected for intensive 
tesdilng of the type of reasoning assigned to the grade level. This 
teaching was done by one of our staff menbers, who were experienced teadiers 
specially trained in logic. In each case it ran for one period per day 
for 10 instructional days (two weeks). 

As a result of this pilot experience, we learned several Inportant 

lessons: 



1. That the amount of time devoted to the instruction was in general 
insufficient. We concluded this because we felt that we had 

not come anywhere near out students* limits for learning logic. 

This was a subjective impression, but quite probably valid. 

2. That in future readiness studies, much more of a student’s time 
must be devoted to the study of logic. Because we were both 
operating on a small scale and insistent upon control over lAiat 
was being tau^t, we had to Introduce our own staff memibers into 
the schools. This inevitably resulted in strong limitations by 
the schools on the amount of a student's time we could have. A 
possible way around this problem, a way not open to us this last 
year beca\ise of budget limitations, is to provide training in logic 
and the teaching of logic for a large number of teachers d^irlng a 
sunsier, and then make use of their regular classes during the 
entire sdiool year. 

3* That some test revision was still necessary. 

If. That the first .year's study should be treated only as a pilot 
study for the reasons given above and that the second year should 
consist of an improved study of readiness for learning deduction, 
with more of a student's time ccanitted than during the first year. 
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l!hat this isqproved study would req[ulre greater concentration 
of our resources and a consequent reduction in the scope of 
the effort. 

6. That sentence reasoning would have to be cut down to conditional 
reasoning^ omitting disjunction^ alternation, and conjxmction 
reasoning. This would be in order to reduce the nunA}er of 
principles to be taught,— that is, to make the teaching task 
more manageable. We Judged the body of basic content in 
conditional reasoning to be roughly equal to that of class 
reasoning. 

To achieve a further reduction we chose to eliminate the lower primary 
grades from the second year's study. The results of the first year 
indicated that, at least as we were going about teaching, not much learning 
of class and conditional reasoning wss going on in those years. Although 
ordinal reasoning was learned in those years, ordinal reasoning is not as 
central in logic as class and conditional reasoning. Since something 
hod to go, we dropped the years in which the most central parts of logic, 
given our limited amount of teaching, were not getting across to the students. 

The concentration of resources was achieved by increasing the amount 
of teaching time to 15 instructional days on logic, generally acconqpe tiled 
by an additional 5 days in Which our staff member devoted himself to ^&e 
advancement of the subject matter ^Ich was being replaced by the logic 
instruction. 

The second year's study is that described in the body of this report. 

The T^sts. 



The original plan called for one deductive logic test, consisting of 
six items per grade level of about 50^ difficulty for the given grade level 
(with some extras at both ends). Ihe result was to have been a 90-item 
test modeled after Burt's Graded Reasoning Test (1919). 
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As indicated earlier one of the results of the analysis of logic 
vas the decision to split deductive logic into parts in order to make the 
teaching more manageable. Hence one test of logic in general vould no 
longer suffice. But there was another reason for changing the original 
test plan. Hie analysis of logic showed not only that there exists a 
small set of basic principles for each of the types of logic, but that a 
general deductive test would yield a score devoid of intrinsic meaning. 

We felt we coiild refine the measure sufficiently to have it be in terms of 
specific principles of logic. Scores on these principles together with 
the operational definitions of mastery of the principles, which are given 
In CSiapter IV, yield a score \dilch hopefully has meaning ^ich is not as 
arbitrary as a total score on a jumbled array of assorted deduction items. 

Hence Instead of one deduction test ^ich yields scores only in terms 
of norms, we developed a test for each of the types of logic studied 
which would yield scores on the principles of logic, scores which are 
interpretable in ordinaiy language. 

The original plan called for 90 items. Oh ere are ikk items in the 
class and conditional reasoning tests (72 items apiece). An additional 
66 items are in the ordinal reasoning test, which is no*- reported on in 
this study. It is being held in reserve for a future phase of the study. 

In the construction of the three tests, an original pool of jkO items was 
prepared -- and supplemented as test developaent, interviews and tryouts 
were conducted. Approximately 30 students were individually Interviewed 
in the preparation of the tests, and about 500 students were used In various 
stages of tryouts. 
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!lhe Readiness Study; The Future 

Tills report covers only the first of a number of phases in the study 
of critical thinking readiness in grades 1-12. In the tentative designations 
of phases to follow, we have broken the process of doing a readiness study 
of an aspect of critical thinking into three parts: the analysis of the 
aspect; the development of a test (or tests) for that aspect; and the 
combined process of testing, teaching, and developing readiness equations. 

All three parts would in general take about three years to carry out for 
each aspect of critical thinking. Starting one aspect per year would 
result in an overall time commitment of about 10 more years. 
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Table VII- 1 . A Tentative Tine Table for Future Fhases of -ttie Critical 
Thinking Readiness Study. 



Academic 

Year 


Aspect 

Analysis 


Test 

Developaent 


1967-68 


Assunptlon-Finding 


Ordinal Reasoning 
(revision) 

Class and Conditional 
Reasoning 
(Grades I-3, adap- 
tation) 


1968-69 


Generalizing 


Alternation and Dis- 
junction Reasoning 
Assumption-Finding 


1969-70 


Reliability of 
Observation Statements 


Generalizing 


•» /vrr/\ m 


Reliability of 
Authorities 


Reliability of 
Observation Statements 


1971-72 


hypothesis Warrant 


Reliability of 
Authorities 


1972-73 


Detecting Ambiguity 


hypothesis Warrant 


1973 - 7 ^ 


Overvagueness and 
Overspecificity 


Detecting Ambiguity 


197 't -75 


Theory Warrant 


OvervaguenesE and 
Overspecificity 


1975- 76 

1976- 77 


Instead of aspect Theory Warrant 

analysis and nev test 

development, this portion 

vill be devoted to 

repeating some 

investigations, and 

writing a total 

report. 



Testing, 
Teaching, and 
Readiness 
Equations 



Ordinal Reasoning: 
(hrades 1-6 

Class and Conditional 
Reasoning: 

Grades 1-3 



Alternation and 
Disjunction Reasoning: 
Grades 1-12 

Assumption-Finding : 
Grades 1-12 

Generalizing: 

Grades 1-12 

Reliability of Obser- 
vation Statements: 
Grades 1-12 

Reliability of Autho- 
rities: Grades 1-12 

'i^ypo'ttiesis Warrant: 
Grades 1-12 

Detecting Antbigui'ty: 
Grades 1-12 

Overvagueness and 
Overspec Iflc ity : 

Grades 1-12 



Theory Warrant: 
Pezb^s Grades 
13-16 



CHAPTER vni - Sunnaxy 



In this chapter we shall try to indicate the nature of the problems 
that we set for ourselves, the interpretation of our key concepts, the 
procedures used to pursue our objectives, and our results. Many qualifications 
will be omitted in order that this overview be in condensed form. Ihe 
reader is referred to the specific chapters in the body of this report for 
a fuller treatment of each topic. Ihis particular chapter is organized in 

the same maimer as ttie report as a i*ole and viU QiMmUy use chapter 
siib-headings. 

Introduction; !Ihe Statement of the Problems . 

Bils study is concerned irith two general empirical questions, uhich 
provide the focus of the study, and several conceptual ones, the answers to 
'^Aiidi, althcu^ amdliary with respect to the empirical questions, are 
iiqportant for the clarity and understanding they provide in dealing with the 
empirical questions. Ohe empirical questions are l) that of readiness for 

mastery of logic, and 2) that of the natural-cultural development of mastery 
of logic. 

The readiness question is concerned with the level (age, grade, etc.) 
at whi(h and the extent to \hich students are ready to master logic. The 
natural-cultural development question is concerned with the levels at which 
and the extent to ihich logic is mastered by students who have not been 
esqposad to deliberate instruction in logic. Presumably this development is 

attributable to both natural and cultural factors; hence the title: ”ftitural- 

Cultural Development of Logic". 

Biese two questions are closely related. If we find out that a certain 
principle of logic has already been mastered by someone as a result of 
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natural-cultural processes^ then the question of readiness for mastery of 
the principle does not arise. Furthezmore the process of estijnatlng idiat a 
student is ready to master is facilitated hy knowing the degree of mastery 
at a given moment. In investigating the readiness question, idilch was our 
primary interest, we unavoidably gath* red Infoimation on the natural- 
cultural developnent question, idiich is the subject of considerable other 
research, especially that of Piaget. Both questions are discussed In 'Uiis 
report. 

In order to discuss these questions some ccrxeptual problems had to be 
dealt with first. First of all we had to delimit 13ie area of logic and 
select a concept of a valid argument that is in agreement with intuition 
and is relatively non-controversial. Hext, we had to develop operational 
definitions of ’mastery of a principle of logic*; but in order to do this 
we also had to do some work on the concept of an operational definition, 
lastly ttie coiKsept of readiness required analysis. 

It mi^t well be that the actual contribution made by this study la 
greater in the area of conceptual clarification than in the actual eBq>irical 
findings. Bie empirical findings are limited by the geographical and 
nu^ferical limitations of -ttie subjects with whom we worked. But the conceptual 
suggestions that were devd.oped can be applied to other studies, of which 
many are needed. 

In order that we can assume theusderstonding of the ccnceptuol points in 
tile presentation of the enpirical findings , the conceptual points will in 
this ch^^r precede the empirical findings which depend \xpan them. 

Ohe lature of the Subject-Matter; Logic . 

Bie subject matter, the mastery of which is the subject of this study. 



o 
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l8 logic, vhich Itself ie an inportant part of our basic interest, critical 
thinking. It is that part of critical thinking vhlch deals with idiether a 
conclusion follows necessarily from the premises that are offered in support 

of it. Ohe centrality of this part of critical thinking has been argued 
for elsewhere (Ehnis, 1^^)^^ 

logic is not concerned with whether the premises or conclusion are true, 
but simply with Aether the former necessarily implies the latter. 

Two ICypes of Logic . 

Ihere are many different types of statements between which this 
relationship of necessary Implication can hold. Roughly speakii®, the 
field of logic is categorized according to the types of statements treated. 

Of the many types of logic idiich exist (no one has successfully defined 

them all), we have selected two of the most coomon, conditional logic and 
class logic. 

Conditional logic deals with statements containing the words, *lf*, ’only 
tf, and/or their synonyDS. It is caUed "conditional logic" becauae ttie 
"orda Juat mentioned are frequently need to Introduce conditiona upon Hiich 
the truth of the reat of a statement containing them dependa. me part of 
a statoKnt introduced by the word 'if ia called the "antecedent". Bie 
reat (except for the word 'then', ahen used to introduce the rent) ia 
■Hie "conaequent". A eliqtle argiaent in conditional logic proceeda by 
preaentlng a conditional statement, then affirming or deicing either the 
antecedent or the consequent, and drawing as a conclusion either the 
affirmation or denial of the consequent or antecedent respectively. If the 
conclusion follows necessarily, then the argiment is called valid. If the 
conclusion does not ..ecesaarily follow, then the argument la called Invalid. 

o 

ERIC 
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Here l8 an exaiqile of a valid axguDent in condltiraial logic, vhich has 
been adapted frm the teat xised In this study: 

Premises: 



If the car in the parking lot is Mr. Smith’s, 
The car in the parking lot is not blue. 

Conclusion: 



then it is blue. 



Bie car in the parking lot is not Mr. anith’s. 

Class logic, lAlch is also concerned wil* the validity of arguments, 

deals with statements idiich have a different structure and a different 

relationship to each other. In conditional logic, the antecedent and 

consequent appear and reappear in the argument essentially unchanged, except 

for the possible negation of one or me omer. Statements in cUss logic 

have es meir basic interchangeable units not sentences that can stand 

independently of each omer, but terms and phrases uhlch refer to individuals 

or groups. For exan^ple, me statement, "AH me cars in me garage are 

Mr. anim's cars”, is a class logic statement because me basic units in me 

statement are me terms, "me ears in me garage” and "Mr. SSrim's cars”, 

mich refer to groups. Bie statement gives a relationship betwen mese 
groups. 

Here, for exas^ile, is a valid argument, mich is an adaptation of an 
item from one of the tests that we developed: 
demises: 

AU tte cm in the garage are Mr. Staith’e cars. 

iui Mr. tilth's cars are Fbrds. 

Conclusion: 

All the cars in the garage are Fbrds. 
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^^tplee of For purposes of Instruction and testing ve 

selected ibat seemed to be the basic elementary principles in each of the 

hbove two types of logic. Ohey are listed below and can be found exen^ilified 
in Chapter II: 

Conditional Logic: 



1. an if-then sentence, the affUnation of the if.part 

the affinaatlon of the then-part. u^iies 

fentence, the aenial of the If-part does not by 
3- an if -thra sentence, the affiasation of the tten-part does 

SSSl“f S-^'' «■* 

5* Ihe if-then relationi^ip is transitive. 

6. An if-then sentence implies its contrapositive. 

7- Bie if-tiien relation is non-sysmetric. 

“? “«“*«“«> «»e aeni^ of the only-if part laalies 

the denial of the major part. 

»*«»«tton of the aajor pert ii^lies 
the affirmation of the only-if part. 

“■ or affliction of one part of an if-and-only-if atateaent 

Holies respectively the denitl or afftnation of theother part. 

oentence, the afflictic of the only-if part does 

* W*ult of its being an only-if part) icly tiie 
affizisation of the major part. ««« 

sentence, the denial of the major part does not by 
of tte oSf-iT^.*^ p»t)laply the denial^ 

Class Logic: 

Mdvt^ wrsaT***^ ^ of that class 
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2. Whatever is a member of a class is also a member of a class in Which 
the first is included, (ttis inplies that class inclusion is 
transitive.) 

3 . Whatever is a meniber of a class is not (as a result of that 
relationship) necessarily a member of a class Included in that class. 

h. Class exclusion is symmetric. 

5« ® meniber of a class is not a member of a class excluded 

from the first. 

6. Whatever is not a member of a class is not (as a result of that 

relationship) necessarily also not a meniber of a class in vhich the 
first is included. 

7 . Whatever is not a meniber of a class is not (as a result of that 
relationship) necessarily a meniber of (nor a non-member of) another 
class %dilch is excluded from the first. 

8. Whatever is not a meniber of a class is also not a meniber of any class 
included in the first. 

Pbr purposes of discussion of development of knowledge and readiness^ 
we have grouped most of these principles according to the following headings: 
conversion^ negation of antecedent^ contraposition, transitivity, and 
*only-if * principles. ALthou^ the terms used in this list of principle 
groups are primarily logical terms, decisions about categorization of 
principles are for psychological reasons as well. This is a rou^ classification 
system. The groi^ings and descriptions are inexact but useful. 

Conversion: The converse of a statement, which, roughly speaking, 
is the statement turned around with the beginning and end exchanged, does not 
necessarily follow from the original statement. The conversion principles 
are Conditional Principles 3 and 7 , and Class Principle 3 . We call them 
"fallacy principles", because they indicate logical fallacies. 

Hsgatlon of ihitecedent: This is also an invalid move. It consists of 
negating the first part of a statement and on the basis of that negation, 
concluding that the second part must be negated as well. Conditional Principle 

er|c 
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2 and Class Principles 6 and 7 are negation-of -antecedent principles^ and 
thus are also fallacy principles. 

Contraposition: lEhis is a valid move. It consists in negating the 

second part of a statement and on that ba^^is concltkding that the first 
part ^ould be negated also. Conditio. lal Principles 4 and 6 are contra- 
position principles, as are Class Principles 5 and 8. 

Transitivity: This too is a valid move for the types of logic we 
studied. It is best explained by a symbolic exan^jle: If X has a given 
transitive relationship to Y, and Y has that sa^s transitive relationship 
to Z, then X has that relationship to Z. Being taller than is a transitive 
relationship, for example. A transitive relationship is one, so to speak, 
that carries throned an intermediary ^en an intermediary exists. Condltioiial 
Principle 5 find Class Principle 2 are clear cases of transitivity principles. 
Conditional Principle 1, is like a transitivity principle, even thou^ 
it does not quite fit the symbolic form mentioned above. It is similar 
in that the affirmation of the antecedent is carried through to the 
consequent. 

*Only-if* principles: These are conditional principles vhich ve have 
grouped together because of the occurrence of the phrase *only if* in 
arguments to vhich they apply. The phrase *only if* indicates a necessary, 
but not necessarily sufficient condition for the truth of the rest of the 
sentence. Three of them indicate valid arguments and two indicate invalid 
arguments. Ohe principles are 8, 9, 10, 11, and 12. We group all 
together because althou^ there are important differences, they seemed to 
us to be conveniently grouped for teaching. 



o 
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An intensive study of Plsget*s logic vas conducted for the purpose of 
coiBparison with the types of logic presented above. Basically we found the 
logics similar althoi;:gh we had reservations. We concluded that Piaget's 
conclusions and cur conclusions are therefore relevant to each other. 

Becaiise of the large amount to be learned in each of the two t^rpes 
of logic we studied, we assigned these two types of logic to alternate 
grade levels within the range studied. Conditional logic was tested for 
and taught at grade levels 5> 7, 9> and 11, ^ile class logic was tested 
for and taught at grade levels k, 6, 8, 10, and 12. 

Basic Data on Subjects . 

Althou^ we had 803 subjects distributed in grades ^-12; (inclusive), not 
all were used in the readiness part of the study. All were used in the 
natural-cultural development part of the study. At each grade level one 
class-size group was selected for purposes of instruction in logic. There 
were 217 of these subjects, called the "LDT's" (for 'logic Deliberately 
^ugbt) idio by design were Intended to be fairly representative of the 
upper New York State school system from ^ich they were drawn. 

From the same school system con^jarable classes were selected, again 
one at each grade level. Obese subjects, called the "LNDT-l's" (for 'logic 
Not Deliberately Taught, 1st group'), were 211 in number. 

irom another i^er New York State school system another 375 students, 
called the ”I2irT-2's", were selected for use, together with the LDT's and 
the INDT-l's, in the natural-cultural development part of the study. 

The following table gives some gross figures about these subjects. 

”SES" stands for socio-economic status, and is based upon a seven-point 
occupational rating scale developed by Warner (19^9, ppl^iO-lln). l is 
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hlfiji and 7 is low. IQ scores for lDI*s and LNET-l's are Lorge-Thomdikes 
for IIinr-2*8, predominately the California Test of Mental Maturity . 
Further details about the instruments and data-gatherlng procedures can 
be found in Chapter III. 

Table VIII-1 Gross Basic Data on Subjects. 





R 


Mean IQ 


SES 


LDT*s 


217 


116.8 


3.8 


mm-VB 


211 


116.3 


3.5 


LNDT-2's 


375 


108.4 


None Calculated 


Total 


803 


112.7 


3.6 (LDT's and INBT-l's only) 



Ihe Cornell Deduction Tfests . 

Two deduction tests were developed, one for each of the types of 
logic treated. They are called "The Cornell Conditional-Reasoning Test, 
Form X and !Ihe Cornell Class— Reasoning Test, Form X". These tests were 
constructed with the purpose of determining whether all but one of the 
principles of logic listed earlier are mastered or alternatively, the 
degree to which they are mastered. The one. Conditional Principle 12, 
was omitted in order that combinations of principles could be Included 
wllhout lengthening the conditional test. Each test contained 72 items 
in 12 item groups of 6 items apiece. Each group of 6 items embodies a 
principle or combination of principles. The six items within any one group 
were scattered. 5he tests were deliberately kept short in order that they 
could be administered in a 40-minute period. 

Operational definitions of mastery of a principle were tied to the item 
groups. Getting at least 5 of the 6 items correct was deemed to be a 
sufficient condition for probable mastery of the principle and getting at 



o 
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least, k coixect vas Judged to be a probable necessary condition, (ihus 
getting three or fewer correct in 5 >lied lack of mastery.) ytxnally put, 

the following are the operational definitions of 'mastery of Conditional 
Principle 4: 



If Y is given "The Cornell Conditlonal-Beasonlng Test, Fbrm X" under 
stantod conditions*, then if Y answers correctly at least five of items 

o, 16, 22, 29, 35 1 and 39, Y has probably mastered Conditional 
Ptinciple 4. 



If Y is given "The Cornell Conditional-Reasoning Test, Form X" under 
stand^d conditions; then it Is probable that Y has mastered Conditional 

if y ansTCra correctly at least four of these items; 

35 , ana 39** 

Making use of the distinctions among types of content made by Wilkins 
(1928) we includ ' ^hree content con^wnents in the tests: the concrete 
familiar, the symbolic, and the suggestive components. Each item 

contains four concrete familiar items, one symbolic item, and one suggestive 
item. 



Concrete familiar items are as the name suggests; furthermore, there is 
no reason to believe that a subject uill, because of background factual 
knoHledge, accept or reject the conclusion of concrete familiar items. Ihe 
previous sample arguments about cars have concrete familiar content. Ihey 
are ebout familiar concrete things, but there is no reason to think that a 
student uill believe or disbelieve that all of Mr. Smith's cars are Ibrds. 

Ihe symbolic component items used symbols Instead of uords referring 

to objects in the sentences in the argument. And the suggestive component 

Items are such lhat the validity status of the argument differs from the 

truth status of the conclusion, rtiich truth status le presumed to be sell- 

know; to the subjects. Ibr example if the conclusion mere "AU cats are 

black", i*ich presumably is known to be false, then the argumpct wwld be 

* dhe theory and defense of such definitions have been presented elsewhere 
by the principal investigator (Ennis, 1964). 






cl'thcr vslid or such 'th&'t it does not inply the denisl of the conclusion^ 
and would have to be recognized as such. This exasvple is the conclusion 
of class item 31, Tjhich contains a valid argument, thus requiring an 
answer of "Yes." 

Bie directions do not vaguely ask for a Judgment about the conclusion. 
They ask whether, on the assunq)tion that nothing but the premises are 
known, the conclusion irould be true. Six sample problems are used to 
Illustrate this type of question. 

Reliability . Reliability was estimated by means of test-retest 
correlations at each grade leve] for the LNUP-l's and LNDr-2*s combined. 
There was approximately a ten-week interval between test and retest. The 
mean of total score correlations was .75 on the conditional reasoning test 
and .83 on the class reasoning test. 

Component score reliability estimates are lower. Mean concrete neutral 
test-retest correlations were .65 for conditional reasoning and .79 for 
class reasoning. Syiribolic conq)onent mean test-retest correlations were .53 
and .50 respectively. For the suggestive conponent the means were .55 
and .63 respectively. 

As mi^t be expected the reliabilily estimates for the item groips were 
again lower. Means were .52 for conditional and .50 for class reasoning. 

Validity. Because of the lack of a dependable outside criterion, no 
concurrent or predictive validity estimates were computed. Basically the 
type of validity with Tdiich we were concerned irais construct validity. Jiuch 
of the argument for construct validity here depends on the content analysis 
on which the cest was based. A study of reasoning in newspaper editorials, 
an auto mechanics handbook, and two U.S. Supreme Court decision opinions. 
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together with intensive study of logic and consultation with logicians, 
provided the basis for the content analysis Judgments* 



A series of tr/outs, concerned with both content and fora of the Items 
was conducted. The finished product was the result of eighteen months of 
concentrated effort on the nature and types of logic, item format, directions, 
and content. An inspection of the items reveals them to be clear applications 
of the principles of logic presented earlier. The details of item 
assignment are to be found in Chapter IV. 

The rest of the argument for construct validity is to be frund in three 
areas; correlations with familiar measures, item analysis, and the role 
played by this test in the current study. Correlations with familiar 
measures, which are mainly based upon pre-tests given to UDT*s and LNDT-l’s, 
may be found in detail in Chapter IV; 423 subjects were used for these 
correlations, l88 on the conditional reasoning test, and 235 on the class 
reasoning test. Some of the more in^wrtant ones follow. 

Jfean correlations with chronological age at a given grade level were 
-.11 and -.12 in conditional and class reasoning respectively, \diich 
relationships are not statistically significant.* In other words, at a 
given grade level, given the present system of advancement through the 
grades, there is if anything, only a slight negative relationship between 
age and mastery of logic. When the various grades are grouped together, 
then, as might be expected, there is a clear positive relationship between 
age and logic mastery, the correlations being .58 and .68 for the two 



tests respectively.** Both are statistically significant. 

Mean correlations with (lorge -Thorndike) IQ were .58 and .52 respectively, 
which are statistically significant and are about vtiat one tends to find in 



* All significance tests used the 5^ level as the criterion. 



** (Hiese particular correlations were based upon a sample of the LDT*s; 
conditional reasoning N = 64; class reasoning, N * 82. 
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correlations between subject matter tests and IQ. Correlations with the 
occupationally- based index of socio-economic status averaged .20 and .26 
on the two tests respectively, both of idiich correlations again are 
statistically significant. 

Qliere appears to be no relationship between mastery of logic (among 

students not yet exposed to instruction in logic) and sex. Tke mean 

correlations were .10 and .00 respectively and were not statistically 

significant. If a relationship does exist, it presumably is a very weak 
one. 

Bie aoove relationships between these two tests and conanon measures 
contribute to the argument for construct validity insofar as they make sense 
and fit into some sort of theory (though it be at a low level). !ihat there 
be either no relationship or a slight negative relationship between knowledge 
of logic and chronological age id.thin a given grade is not surprising, 
given that promotion is not a con 5 >letely automatic thing. If bright young 
students can at least occasionally move ahead, on the assun5>tion that know- 
ledge of logic is related to brightness, then a positive relationship 

between chronological age and knowledge of logic at a given grade level 
would be defeated. 

If knowledge of logic can be presumed to increase with age, then there 
should be a positive correlation between logic test scores and chronological 
age, Tdien separate grades are grouped together. And if logic is an 
intellectual ability, then scores on these logic tests should be related 
to IQ scores. On the same assun 5 >tion, with the additional assunqption that 
there is greater intellectual development among the children of .the higher 
socio-economic classes (excluding upper-upper classes, of whom there were 
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fev or none In this study) at least some positive relationship between 
socio-economic status and logic test score should be found. And lastly 

we know of no reason to expect one sex to be better than another on a test 
In logic. 

Die results on these tests conformed to expectations and are under- 
standable and plausible. Hence these correlations with familiar measure 
support the argument for construct validity. Naturally this is only 

support, not confirmation, since other interpretations could be given to 
the data. 

Item analysis information, idiich is presented in detail In Chapter IV 
and the Appendix, gives us more information about the test. We have no 
theory to predict the results of the item analyses that we performed, but 
do not find the results exceptional. 

Bie mean difficulty levels of the total tests (ranges: - 61.5 

for conditional; ^9.3 - 72.7 for class) show that the tests are not too 

dlfflcxilt for the grades at idiich they were administered if one is 

interested in total score. Since our major interest is in idiether or not 
a principle has been mastered, this criterion is not one that must be 
satisfied in order that the test be usuable for our purposes. That it is 
satisfied is interesting, but not crucial. 

The mean discrimination indices were 26.0 on the conditional test and 
29*8 on the class test. When the mean discrimination indices were counted 
for the various item groups at the various grade levels, some variability 
was evident, which will be discussed under the next topic. There was one 
group which consistently failed to discriminate. Conditional Item Group 12, 

* Ihese figures ore means of the percentages of students getting each item 
right at a given grade level. 
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\Alch calls for the combined application of Conditional Principles I and 
»f. This lack of discriminating power we attribute to the great difficulty 
of the items in this group (index hovering around 20^ for all grade levels). 
Since the function of the test is to see if certain principles and 
combinations thereof are mastered, the lack of discriminating power of this 
item group is not a defect. It would be a defect if the test were used 

with similar groups for purposes of discriminating among the members of 
those groiqps. 

Ihe last type of evidence regarding construct validity is the role 
played by these tests in this and other studies. Since they have not yet 
been used in other studies, only the results of this one can be presented. 
The rest of this chapter, in its description and analysis of the results, 
is thus also an in5)licit discussion of construct validity, on the assun?)tion 
that greater understanding of test results contributes to construct validity. 
^e Natural Cultural Development of Knowledge of Logic . 

Partly because Piaget's claims about development (without deliberate 
instruction) of knowledge of logic are vague and sometimes ambiguous, and 
partly because we worked with students in the age range 10-18, there is in 
this study actually no direct and unequivocal test of his views. But his 
studies did suggest the following questions: 

1. Is there actually a development of logical ability as children 
grow older? 

2. Does this development (if there is any) come in stages? 

3» Is conditional logic mastered by age 11-12? 

Is class logic mastered by age 11-12? 

5. Is the truth-validity characteristic (essentially the mastery of 
the suggestive component) achieved by age 11-12? 
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logic, is there a development of one sort of 
thing before another such that some things are more difficult 
than others at a given level? 



Answers to the first five of these questions are suggested or indicated 
,«re suMcsted by wr atudy, 

in the literature/and are fairly obvious and routine for anyone vho has 

worked w^.th children and thought about the questions. The answers are as 
follows: 



1. Yes. 

2. That depends on what you count as a stage, but groBB plateaus 
extending over a period of years were not evident. 

3» Partly. 

Partly. 

5* Partly. 

Bie sixth question is an extension of the 3rd, kUh, and 5th in that it is 
concerned with the extent to \diich various parts are mastered. It is the 
sixth question idiich is the interesting one to our minds and is the one 
toward which this study has made contribution, if it has made any contribution 
in the area of the natural-cultural development of logic. Part of the 
contribution lies in the formulation of the question, and part lies in the 
empirical findings. Hie latter part is inevitably quite modest because of. 

the size of the group and the fact that it is conposed cJ students from only 
one small part of the world. 

We found considerable similarity in the developmental patterns of the 
tW) types of logic studied, vith the exception that class logic appeared 
to be easier all along the line. Ihe principles e;q>ressing the basic 
fallacies (conversion, negating the antecedent) were the most difficult 
at ages 10-12, but there was considerable improvement in .these over the period 
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stttdled (age 10-18). Among the validity principles, the contraposition 
ones contrast with the transitivity principles in that althou^ both are 
at medlnm dlfflculiy at age 10-12, there is little Improvement over the 
years in the contraposition principles, i*ereas there is considerable 
Improvement in the transitivity principles. 

Althou^ we found parallel patterns among the types of principles in 
the two types of reasoning studied, we did not find as much parallelism 
between the two types of reasoning «icn we examined the three cosgionente 
of reasoning (concrete familiar, symbolic, suggestive) *lch were buUt 
into the tests. One parallel feature that we did find was the fairly 
regular Hunrovement over 1*e years studied in all three cosgxsnents on 
both tests. But there was a marked difference. 

On the conditional reasoning test the three components were of about 

equal difficulty at each grade level. But on the class reasoning test, 

the concrete familiar cosqwnent was in general easier than each of the other 

cosqonents, particularly the symbolic conqonent. At all five grade levels 

the mean difficulty index differences between the concrete familiar cosqxment 

and the sysibolic component exceeded ten percentage points, and in three of 

the five grade levels the differences exceeded twenty percentage points 

and were statistically significant. And the differences between the concrete 

familiar components and the suggestive component also exceeded ten percentage 

points at all grade levels tested. One of these differences was statistically 
significant. 

Previous studies that have shown the suggestive and syniboiic conq»nents 
to be more difficult than the concrete familiar cosqx,nent have all used class 
reasoning. One wonders why the difference in difficulty did not appear in 

o 
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conditional reasoning. In developmental terms one wonders i*y the 

suggestive and symbolic components lag behind the concrete familiar 

component In class reasoning, but not In conditional reasoning. 

*lch were proposed In Chapter V suggest that the differences result from 

the nature of the logic being Investigated and from the difficulties that 

uninstructed students have In dealing with the use of symbols to represent 
sentences. 

Bie Develppment of Beadlness to Utecter 

Ihe concept readiness to master a nrlnelplp was studied and the 
following rough and scanevhat vague analysis was the result: say that 

r la ready .o master Principle X Is to say that Y has the disposition, 
given suitable conditions, to develop another disposition, ihich Is the 
disposition to show, given suitable conditions, the sort of behavior that 
a person rtjo has mastered Principle X would show, ais analysis assumes 
a prior specification of the meaning of ’masteiy of Principle X', i*ich 
Is In part provided by the operational definitions given earlier. The 
analysis Is cospllcated by the double dlsposltlonality of the concept; a 
disposition to develop a diaposltion is imder consideration. And the 
analysis twice makes use of the vague terms 'suitable conditions'. But 
this is because the concept being analyzed is vague In the same way. ffie 
person using the concept readiness must judge Aether the amount of effort 
needed to achieve the desired mastery or learning Is worth the trouble. 

Jtod he makes i^elt reference to possible means for achieving the mastery 
or learning but he need not specify the means. A person claiming that Y 
la ready to master Principle X Implies that the means of bringing Y to thi. 
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mastery exist and are feasible, but the means are not necessarily 
specified In the statement claiming readiness. Hence the concept, 
like the jihrase, ’suitable conditions’. Is vague. 

In this part of the study, we concentrated on two empirical questions 
In addition to the question of the analysis of readiness for mastery; 

1. What were our subjects ready to master? 

2. What are fairly comparable students ready to master? 

Bie first question Is a question of description and the second a question 
of prediction. 

In the first question the term *our subjects’ refers to the LDT’s. 

Obey were given the pre-test, were taught logic for I 5 days, one period 
per day, and approximately six weeks later, were given the post-test, 
which was the same test as was used for the pre-test. Teaching was done 
by members of the project staff, >flio were given special training in logic 
and were ejqperienced teachers at the grade levels with idiich they worked. 

What Our Subjects Were Ready to Master . 

The parallelism between the two types of logic that we found in the 
natural-cultural development of principles was not to be found in the 
tea<diability of principles - nor In Improvements in component and total 
scores. In class logic modest Inprovements In total scores, conponent 
scores, and principle scores generally occurred in students from age 11-12 
ipward during the teaching period. But in conditional logic the younger 
students in our study registered virtually no inprovement, while the upper 
secondary school students registered a marked Inprovement in total scores, 
component scores, and the fallacy principle scores after having been taught. 
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Class reasoning Is apparently teachable to some extent from age 11-12 
onwards. Students younger than that did not benefit from the 15 days of 
instruction that we were able to give them. Perhaps \mder different 
conditions - or with more time - they also would have benefited. Prom 
11-12 onward there is apparently modest fairly even in^rovement as a 
result of Tdiatever natural -cultural sources are operating, and deliberate 
teaching of the sort we did can contribute modestly to this in^rovement. 

5y age 17-18 there was as a result of existing natural-cultural influences 
on our LRP*s considerable mastery of the basic ->rinciples of class logic. 

Our teaching made a modest improvement. Overall, talking in terms of 
readiness, we can say that from age 11-12 onward our students were ready 
for modest inprovements in mastery of the principles of class reasoning, 
and that by age 17-18, the group as a whole was ready to make the modest 
improvement that idien made justifies our saying that for practical purposes 
they have mastered the basic principles of class logic. 

Conditional logic makes a different story. Apparently, when given the 
sort of instruction we provided, our LDT's were not reac^y to make rnuo h 
improvement until \pper secondary; but by age 16-17 were ready to make 
great strides. 2hese great inprovements in mastery were particularly 
evident among the fallacy principles {vhere there was much room for 
improvement); but they also occurred among the contraposition principles, 
the affiiming-the-antecedent principle and to a sli^t extent the transitivity 
principles. Mb improvement was registered among the *only-if principles, 
though this might be because insiafficient time was devoted to them and at 
the outset the 16-I7 year o:i,ds were fairly good at them. 

It is quite possible that our data suggest a line between tbs ready and 
nonready that is sharper than it should be. We have some question about the 
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no’fcivatlon of the 9^ grade U3ID*s* In any case our llth graders vere by 
and large ready to master the fallacy principles, and our 5th and 7th graders 
were not. Biis is the most striking finding in this readiness study. 

2* Plat Which Fairly Comparable Students Are Ready to Master . Using 
the relationships between scores on certain variables (described earlier) 
and the im post-test scores, and the interrelationships among these 
variables, we constructed multiple-regression equations for the purpose 
of predicting idiat other fairly comparable students are ready to master. 

Two sets of equations were prepared, one making use of pre-test scores on 
"Uie same logic test, and the other not doing so. Variables used in bo'tii 
sets are grade level, chronological age, IQ, socio-economic status, and sex. 
All grade levels on each test were combined; that is grades 5, 7, 9, and 
11 (9^ students in all) were combined for the conditional logic equations, 
and grades, U, 6, 8, 10, and 12 (123 students in all) were combined for the 
class logic equations Equations for each item-groiq) score, each cooqponent 
score, and each total score were prepared. Altogether that makes 64 equations. 

Tbtal score cross validation estimates with and without the use of the 
pre-test were .77 and .69 respectively for conditional logic and .86 and 
.78 respectively for class logic. Conq)onent score cross validation estimates 
ranged aro\md .70 for conditional logic and around .75 for class logic, 
with the ones using pre-test score running hi^er than the ones without. 
Conditional logic item group cross validation estimates ranged around .50 
and .4o respectively with and without pre-tests; class logic estimates 
ranged around .60 and .55 respectively. 

Piese item-group cross validation estimates are not adequate for the 
prediction of individuals scores. I^ftiether they are high enoug^i for prediction 



* ^3 + 1) (2) (2). Not all item groups uniquely tested for a principle. 

Biere were twelve item groiqps in each test end an equation constructed 
^ for each one. 
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Of central tendencies of groups is an open question, but because of our 
interest in vorking out a technique for predicting mastery in a group, ve 
developed such a technique and offer it as one ^ich must be refined and 
investigated, both enq)irically and statistically. 

Ttie technique is as follows: Inssrt into the equation the mean values 
of the variables for the group in \diich we have an interest. Extract a 
predicted mean item group score. Convert the predicted score into an item 
group mean difficulty index. Use this to enter a graph Which provides an 
empirically derived conversion to percentages m. .-ting the sufficient condition 
for mastery and failing to meet the necessary condition for mastery. (See 
operational definitions on p VIII-IO.) ae results ar^ the percentages 
that are predicted to obtain after instruction. If the pre-test has been 
given, then one can readily obtain the percentage that already lisve mastered 
the principle, and estimates of the percentage that are ready to taster and 
the percentage that arc aot ready to vaster It* 



Weights and constants for constructing these equations can be found in 
the Appendix in Tables A-ll through A-l4. The graph for converting from 
mean difficulty indices to necessary and sufficient condition percentages 
is to be found in Chapter VI (Graph VI-l). Ohe foUowing is a sanple working 



throuf^ of the above-described process, making use of the mean value of the 
nth grade LDT*s for purposes of niustration. Mastery of Conditional 
Principle # is the subject of this prediction effort: 
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Values going into the equation: 

Grade 

Chronological Age 
IQ 

Socio-economic Status 
Sex (male, 1 
female, 2) 

Total Score on Pre-Test 
Pre-test Score on this Item Group 



Measured 
Value (rounded) 
11 

199*8 mos. 
116.0 
3*5 
1*5 

63.7 

4.26 



Constant: -1.26 



Weight 

-.001 

.0074 

.0064 

-.127 

.423 

.0384 

.314 
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Predicted score = (-.001) (ll) + (.0074) (199.8) + (.0064) 

(ll6.'b) + (-.127) (3.5) + (.423) (1.5) + (.0384) (63.7) + (.314) 

(4.26) - 1.26 = -.01 + 1.48 + .74 - .45 + .63 + 2.44 + 1.34 - 1.26 

= 4.91 j predicted score . 

This figure, 4.91, can be rounded or not, depending on uhat one is 
going to do with it. 

The predicted score of 4.91 corresponds to a mean difficulty index for this 
item group of 82# (4.91/6 = approx. .82). Entering graph VI-1 we obtain 
predicted percentages of I3# falling to meet the necessary condition and 
72# meeting the sufficient condition for mastery. Incidentally the actual 
percentages turned out to be 15# and 77#. 

O9 the pre-test 23# failed to meet the necessary condition and 50# 
met the sufficient condition. Eence the claim that results from the prediction 
is ttiat probably at least 22# (72# minus 50#) are ready to master the 
principle and at least 13# are not ready to master it. 50# had already 
mastered it; the other 15# (lOO— 50 -22 -13 = I5) make up the group about 
idiich we do not want to make any sort of commitment. 

Heeded Ftother Research . 

This study has only begun to explore the topic. The following steps 
are desirable: 

1. The checking of the response form (multiple choice) of the tests 
against an open-ended test form. 

2. Itevision of the teste to adapt them to students in the first 
three grades. 

3- lengthening of the tests so that measurement of mastery of each 
principle by an individual becomes more reliable. 
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4. Beplication with more classes at each grade level in different 
types of environment to minimize the effect of class-vide factors. The 
in-between grade levels should also be used. This should be done for both 
the natural-cultural and readiness parts of the study. 

5- Ejctension with adaptation to lower age levels (ages 6-10), again 
for both enqpirical pairts of the study. 

6. The use of variation in amount of teaching time as a variable in 
the multiple regression equations. 

7- More radically, the training in logic of full-time teachers, followed 
by their instructing logic in their own classes, in order to secure more 
time devoted to logic teaching in LOT classes, and at the same to maintain 
a more realistic situation. Again the readiness questions would be asked. 

8. A close examination of the source of iaqurovement in conditional 
logic among the LOT upper secondary students, with this specific question 
in mind: Is this learning merely the acquisition of new meanings for words 
or is it an increase in grasp of concepts and principles? 

9* B>5)irlcal and mathematical investigation of techniques for predicting 
percentages who are ready to master a principle, making use of the 
(^[>erational criteria advanced here (or similar criteria). Such investigation 
should attempt to indicate the extent to which such procedures are likely to 
be in error. 

10. The investigation of the readiness development and natural-cultural 
development of other aspects of critical thinking. Including analysis of 
the aspect, test development, and testing and teaching of the aspect. It 
would probably be better in the future if existing classroom teachers were 
used, but only after thorough training. 
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Overvlev. 



The products of this study are as follows: 

1. The specification of a set of basic principles of two *raJor 
“^rpes of logic, conditional logic and class logic. 

2. Two logic tests, one on each of these types of logic. 

3 . A theory of operational definitions. 

k. Operational definitions of mastery of each of the principles in 
terms of the two tests. 

5« An analysis of Piaget’s conception of logj.c. 

6. A suggestion of the patterns of natural-c iltural development of 
knowledge of logic from ages IO-I 8 among students like those 
studied here. 

7* An analysis of the concept, readiness to master a principle . 

8. A description of vhat amounts of logic our subjects were ready 
to master (given 15 days of logic instruction). 

9- A set of 6k multiple regression equations for predicting the 
amount of mastery of logic (given coD^>arable instruction) in 
groups comparable to those with which we worked. 

10. A procedure to estimate the percentage of students in a given 
class idio are ready, fcc master and the percentage Who are not 
ready to master a given principle of logic. 



Fhrttier research is needed on all these items. 
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APPESDJX A. TABLES AND GRAPHS. 



The tables and graphs presented In this part of the appendix are 
listed at the beginning of the report under the heading. "Tables and 
Graphs". 
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Table A-3, Individual item and Item Qrotg^ Mean Dlscplalnation Indices By 
Grades on the CSonditional Reaksning Test for All Subjects 
on the ^-Test. 



Grades 


05 


07 


09 


11 




102 


99 


60 


78 



Item Groiip 01- 
Item IVumber 



07 


26 


19 


23 


43 


Ik 


11 


30 


0 


43 


19 


30 


15 


14 


10 


27 


59 


22 


27 


29 


31 


56 


52 


27 


52 


ko 


4l 


56 


23 


33 


Mean 


37 


32 


19 


35 


Item Group 02- 
Item Bomber 


09 


-26 


11 


5 


43 


13 


-15 


26 


9 


29 


18 


-15 


4 


-18 


5 


23 


0 


15 


9 


33 


26 


-22 


22 


23 


48 


34 


-30 


22 


5 


10 


Mean 


-18 


17 


5 


28 


Item Group 03- 
Item Hifflber 


11 


- 7 


7 


5 


38 


24 


-30 


-22 


5 


29 


30 


-30 


7 


- 9 


38 


32 


4 


26 


0 


43 


37 


- 7 


15 


5 


^14 


4l 


- 7 


4 


18 


43 


Mean 


-13 


6 


4 


29 


Item (hroup 04- 
Item Busiber 


08 


4l 


15 


27 


24 


l6 


11 


56 


l4 




22 


59 


19 


36 


5 


29 


70 


37 


4l 


38 


35 


48 


4l 


5 


-14 


39 


70 


37 


22 


33 


Mean 


50 


34 




25 



o 

ERIC 



I&ble A-3 cont. 



Grades 


05 


07 


09 


u 


H « 


102 


99 


80 


TB 


Item Group 05 . 










Item Number 












22 


30 


32 


57 


1^9 


33 


59 


18 


0 


52 


37 


37 


23 


48 


55 


37 


30 


9 


19 


66 


30 


4l 


32 


48 


73 


63 


63 


32 


43 


Mean 


37 


43 


24 


36 


Item Gr<»;^ 06« 










Item Nuniber 










46 


4l 


4l 


14 


38 


50 


4l 


30 


l4 


w 


56 


37 


22 


32 


0 


61 


67 


37 


0 


-14 


69 


70 


26 


9 


19 


74 


48 


30 


14 


29 


Mean 


51 


31 


14 


14 


Item Group 07* 










Item Nuiaber 










44 


. 4 


4 


9 


^^3 


57 


0 


22 


9 


48 


59 


-19 


7 


4l 


62 


64 


-22 


11 


32 


43 


70 


- 7 


4 


27 


52 


77 


-22 


7 


18 


71 


Mean 


12 


9 


23 


53 


Item QrcKip 08« 










Item Mber 










12 

15 


4l 

59 


33 . 

33 


27 

23 


33 

14 


21 


33 


4l 


23 


5 


25 


4l 


33 


36 


76 


36 


fl 


33 


27 


29 


42 


48 


37 


55 


29 


Mean 


48 


35 


32 


31 




Ditble A*3 etmt* 



65 07 09 il 

H « 99 80 78 



Item (£roup 09* 



Item Kuoiber 



10 


30 


52 


27 


19 


17 


37 


26 


l 4 


19 


20 


kS 


33 


36 


10 


28 


7 ^ 


11 


32 


10 


33 


- k 


52 


0 


67 


38 


52 


26 


23 


14 


Mean 

Item Group 10 . 
Item IVumber 


ho 


33 

i 

i 


22 


23 


43 


56 


US 


55 


57 


51 


2 i 8 


63 


55 


US 


62 


22 


4 l 


14 


38 


67 


33 


56 


50 


43 


72 


33 


30 


36 


43 


76 


26 


41 


27 


US 


Mean 


36 


J :-6 


39 


U6 


Item Group 11 . 
Item Cumber 


^^7 


i »8 


7 


5 


5 


5 ^^ 


52 


22 


36 


10 


58 


19 


26 


36 


76 


60 


56 


iih 


32 


29 


63 


:h 


hi 


27 


14 


78 


63 


4 l 


36 


5 


Mean 


52 


30 


29 


23 


Item Group 12 . 
Item Number 




-15 


-11 


0 


0 


53 


15 


18 


18 




65 


- 7 


- 4 


0 


-14 


68 


0 


0 


5 


-33 


71 


11 


15 


0 


- 5 


75 


- 7 


-22 


- 5 


0 


Mean 


0 


1 


3 


6 




iop ana bottom groups midi mm oomrtd mm xbd 6i 
. 27^ of tiiis I. 



Uble Indlviduil Ztaa and Ito^ Oaoup Nte DUcrlwlnatlon ladiett GMcs on 
GOUim RBMOBliig 9tst ton All MJeeta on tht Art-Sift. 



Chradet 


- ok 
9k 


06 

103 


08 

100 


10 . 
75 


12' 

72 


• 

It«B Oacoup (XL* 

IteaMber 

08 


kk 


21 


15 


« 

0 


10 


16 


ko 


18 


7 


10 


0 


22 


52 


32 


30 


5 


15 


29 


36 


0 


26 


5 


5 


35 


68 


Ik 


19 


5 


15 


39 


80 


50 


30 


5 


15 


Merni 


53 


23 


a 


4 


10 


Itoi 0KOI9 02* 


- 








* 


Itoi Htariber 


07 


1|0 


a 


33 


10 


5 


Ik 


28 


29 


30 


5 


25 


19 


32 


25 


59 


30 


*^5 


27 


20 


11 


19 


0 


0 


31 


68 


68 


52 


15 


30 


1|0 


8 


11 


30 


30 


15 


Mean 


33 


27 


37 


15 


20 


Iten Qroi9 03* 
Item Ikaid>ar 


11 


36 


32 


48 


50 


60 




28 


43 


37 


30 


4o 


30 


0 


25 


- 4 


20 




32 


52 


43 


52 


20 




37 


2k 


6l 


52 


35 


45 


kl 


k 


39 


52 


80 


55 


Mean 


2k 


4l 


40 


39 


^^5 


Item 0m9 04. 
Item Mber 


09 


36 


36 


15 


5 


30 

30 


13 


12 


a 


37 


40 


18 


36 


29 


56 


50 


40 


23 


12 


0 


41 


30 


60 


26 


16 


57 


33 


10 


20 


3k 


12 


0 


7 


20 




Hean 


21 


24 


32 


26 


3^ 



er|c 



Ublt A<^ eoDt* 



I "> 

Itoi Ctroi9 05 « 

Item Aafl>er 
10 
IT 
20 
26 
33 
38 

Mean 

Item Cboup 06. 

Item Mber 
12 
15 
a 
25 

ll2 

Mean 



04 

94 



o6 

103 



08 

100 



10 

T5 



12 

72 



36 


18 


30 


5 


25 


52 


l4 


4 


20 


15 


16 


7 


4 


5 


10 


32 


50 


33 


-10 


10 


. k 


11 


33 


35 


70 


48 


-14 


15 


10 


5 


30 


l4 


20 


u 


23 



4o 




52 


5 


25 


4 


- 4 


33 


55 


4o 


8o 


43 


30 


15 


35 


4o 


14 


7 


- 5 


5 


36 


71 


56 


15 


35 


4o 


T 


52 


10 


15 


40 


27 


38 


16 


26 



Item Qmoeqp 07* 












Item tatar 












kk 


16 


25 


52 


40 


55 


57 


-12 


43 


37 


60 


55 


59 


0 


71 


- 7 


-15 


- 5 


64 


.16 


29 


4l 


35 


70 


70 


32 


61 


44 


30 


4o 


77 


20 


39 


59 


40 


65 


m# 

NMHI 


7 


45 


38 


32 


47 


Item CM019 08« 












Item tabar 












48 


16 


32 


26 


45 


50 






54 


V .59 


15 


45 


65 

68 


3? 

44 


1 




60 

40 


20 

50 


71 


36 


43 


52 


20 


50 


75 


16 


25 


44 


50 


6 d 


tfaam 


28 


42 


43 


3B 


46 



er|c 



Ttoble Amk eont. 



Qrades 


04 


06 


08 


10 


12 


H • 


9 ^ 


id 3 


100 


75 


72 



Item Qeoap 09 * 



Item Aariber 





iiO 


25 


41 


25 


45 


k$ 


32 


29 


37 


20 


55 


52 


32 


36 


37 


0 


5 


55 


4o 


11 


22 


35 


-10 


66 


68 


39 


44 


5 


40 


73 


37 


-14 


15 


20 


25 


Mean 


42 


21 


33 


18 


27 


Item Group 10 . 












Item Hiiiober 












43 


24 


43 


22 


10 


20 


51 


36 


50 


52 


45 


45 


62 


24 


29 


44 


0 


0 


67 


16 


14 


26 


5 


0 


72 


28 


7 


30 


20 


10 


76 


52 


46 


63 


45 


50 


Mean 


30 


32 


ko 


a 


a 


Item Group 11 . 












Item HUalber 












47 


4o 


29 


30 


15 


4o 


54 


60 


14 


52 


5 


15 


58 


56 


43 


33 


30 


35 


60 


44 


68 


74 


15 


55 


63 


12 


0 


k6 


10 


30 


78 


20 


11 


37 


40 


55 


Mean 


39 


27 


46 


19 


38 


Item 0 roi 9 12 . 












Item Asriber 












46 


20 


50 


37 


P 


25 


50 


32 


36 


78 


4o 


70 


56 


0 


- 7 


19 


5 


0 


61 


20 


14 


P 


45 


4o 




12 


25 


fa 


0 


65 


74 


56 


43 


48 


25 


90 


Naan 


23 


27 


43 


28 


42 



« 



Tm tq? end bottom groove ilileli oadli mm coa^ered mm Mde 19 of Zlf 
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TABUB A-^. Conditional Reaaoning Adjuated-Mean Foat«Teat Coapariaona 
of Studenta to Logie Vaa Oallberattly Tauc^t and 
Stttdenta to Mhcai Logic Vaa lot LellLaratcly Tiaugbt. ^ 



Grade 

Group 

Jh 


LDT 

27 


"5 

IlDT-l 

26 


LDT 

24 


"7 

IRBT-1 
S 3 


LDT 

17 


"5 

UIDT -1 

23 


LDT 

26 


11 

LIDT -1 

22 


Total 


Score 


k6.k 


4^.6 


55.4 


36.2 


47-3 


54.3* 


77 . 6 » 


62.4 


Coopo- 

nent 


CF 


2k.2 


2 h .5 


28.3 


29.0 


25.7 


28.1* 


38.0* 


31.8 


SY 


6.2 


5.9 


7.4 


7.5 


6.3 


7.0 


10 . 0 * 


7.8 


SU 


5.6 


5.5 


6.5 


6.2 


5.2 


6.0 


9.2* 


6.3 


Iten 

Group 


1 


4.6 


4.4 


5.2 


5.1 


4.7 


5.2 


5.7 


5.2 


2 


1.4 


1.8 


1.8 


1.3 


1.4 


1.2 


5.1 


2.0 


3 


2 . 1 * 


1.0 


2.1 


1.2 


1.7 


1.5 


4.8 


1.7 


k 


3.1 


3.4 


4.4 


4.6 


3.9 


3.9 


4.8 


3.9 


5 


4.0 


3.9 


4.7 


4.8 


3.8 


4.6 


5.2 


5.1 


6 


4.0 


3.9 


4.0 


4.1 


2.3 


3.8 


5.1 


3.4 


7 


1.2 


1.3 


1.2 


1.8 


1.8 


2.4 


4.7 


2.6 


8 


3.9 


4.0 


5.2 


4.6 


5.1 


4.4 


4.6 


5.3 


9 


4.0 


4.5 


5.5 


5.1 


5.0 


5.0 


4.7 


5.7 


10 


3.0 


3.7 


4.7 


4.4 


4.7 


3.9 


5.1 


5.5 


11 


2.9 


3.2 


3.7 


4.6 


3.1 


4.2 


4.2 


4.4 


12 


1.8 


1.2 


1.0 


1.1 


0.6 


1.1 


3.8 


1.2 



* An tattrlak ia placed Lgr eaOh atatlatieaXljr aignifieant^ at^arlor 
ad^uatad aean. 



Vote: Ataa adjnatcd Mana art part of the outcoaK of an analjaia of 
oovarlaaet in liiidi XQ and pra«>taat aeore wre held oonatant* 



TABLE A-6. Class Beasoslag Adjusted-Mean Boat-Test Coa^arisons of Students 
to Whom Logic Was Deliberately Taught and Students to Whom 
Logic Was liot Deliberately Thught. 



Grade 

Group 

N» 


LDT 


"TJ 

IlDT-l 


LDT 


15 

LHDT-l 


LDT 




IlDT-l 


LDT 


io 

LHDT-l 


LDT 


IS 

LHDT-l 


Tbtal 

Score 


44.8 


U 7.3 


63.8# 


55.3 


68.1 


65.4 


81.4 


77.3 


87.8 


82 . 6 » 


Compo- 

nent 


CP 


26.2 


26.8 


34 . 8 ^^ 


31.2 


36.7 


35.1 


40.7 


4 l.O 


43.7 


42.1 


SY 


5.1 


4.9 


6 . 7 b 


5.3 


7.5* 


6.1 


9.1 


7.9 


10 . 3 » 


8.8 


SU 


4.7 


5.3 


7.0 


6.2 


7.8 


7.3 


9.6 


9.1 


10.5 


10.0 


Item 

Qroiq) 


1 


3.9 


4.3 


5.7 


5.3 


5.6 


5.7 


5.7 


64 ? 


5.9 


5.9 


2 


4.1 


4.0 


4.9 


4.6 


5.3 


4.8 


5.4 


5.5 


5.8 


5.8 


3 


2.2 


2.4 


3.4 


2.7 


4.2 


3.8 


5.2 


4.6 


5.5 


5.3 


4 


2.1 


2.7 


3.5 


2.5 


3.1 


2.8 


4.8 


3.9 


5.3 


4.8 


5 


3.9 


4.1 


4.8 


4.4 


5.2 


4.6 


5-1 


5.2 


5.7 


5.2 


6 


3.8 


3.2 


4.7 


4.4 


5.2 


4.5 


5.2 


5.5 


5.6 


5.4 


7 


2.0 


2.3 


2.9 


2.3 


3.5 


2.9 


4.4 


4.1 


4.7 


4.2 


8 


2.1 


2.2 


3.1 


2.8 


4.1 


2.8 


5.2 


4.4 


5.5 


4.9 


9 


3.2 


2.9 


4.0 


3.4 


3.7 


4.0 


4.5 


4.0 


5.2 


4.8 


10 


2.3 


2.2 


3.6 


2.7 


3.2 


3.4 


3.5 


.^•5 


4.2 


4.3 


11 


2.6 


2*6 


3.8 


3.4 


4.7 


4.6 


4.9 


5.4 


5.1 


5.2 


12 


4.0 


3.8 


4.6 


3.7 


4.9 


4.1 


5.2 


5.5 


5.7 


5.4 



* An asterisk is placed by eadh statistically signlfleaiitly f^iptrlgr 



later "lieil 







■n 



V 



TABLE A-7. and Boat-Teat Mean Dlfficultj Indices for Students to 

Iftioei Conditional Seasoning Was Deliberately Tau|bt> by Item 
Croups and Grades. 







Group 


Test 


dra^ 

N» 


5 — 

ar 


7^ 

2k 


5~ 

17 


— n 
26 


1 


Rre 




6tt 




t4 


bb 




Boat 




7T 


83 


78 


97 




Qxange 






7 


k 


9 


2 


Bre 




30 


21 


15 


34 




Post 




25 


28 


24 


84 




Change 




- 5 


7 


9 


50 


3 


Fre 




2k 


2k 


29 


4l 




Boat 




35 


35 


31 


94 




Change 




11 


11 


2 


53 


k 


Pre 




51 


68 


59 


71 




Post 




k9 


7^^ 


63 


82 




Change 




- 2 


6 


4 


11 


5 


Pre 




56 


73 


68 


87 




Boat 




67 


80 


65 


91 




Change 




11 


7 


- 3 


4 


6 


Bre 




kk 


71 


58 


67 




Boat 




65 


67 


37 


86 




Change 




21 


- 4 


-21 


19 


T 


Pre 




15 


15 


28 


53 




Post 




21 


20 


33 


80 




Change 




6 


5 


5 


27 


8 


Bre 




71 


83 


71 


88 




Boat 




63 


77 


79 


80 




Change 




- 8 


- 6 


8 


- 8 


9 


Fre 




70 


83 


80 


93 




Boat 




72 


91 


84 


80 




Change 




2 


8 


4 


-13 


10 


Pre 




50 


76 


68 


88 




Boat 




kS 


78 


62 


91 




Change 




- 2 


2 


- 6 


3 


U 


Pre 




^^7 


72 


62 


72 




Post 




kS 


65 


49 


71 




Change 




1 


- 7 


-13 


- 1 


IS 


Bre 




31 


16 


28 


18 




Boat 




30 


13 


10 


62 








- 1 


a. 


-18 


44 




V 



4 



TABLE A-8. Fre- and Poet-Tests Percentages of LDT's Who Met the Sufficient 
Condition for Mastery^ and Percentages Who Failed to Meet the 
Necessary Condition for Mastery of Principles of Conditional 
Reasoning, By Item Group and Grade. 



o 

ERIC 



Jfceting the Failing to Mee^'^e 

Sufficient Condition Necessary Condition 

Item Grade 579 11 57911 



Group 


Test 


27 


24 


17 


26 


27 


24 


17 


26 


1 


Pre 


ua 


54 


53 


81 


04 


17 


24 


08 




Post 


63 


59 


53 


96 


22 


13 


12 


00 




Change 


15 


5 


0 


15 


18 


- 4 


-12 


- 8 


2 


Pre 


o4 


00 


00 


12 


85 


91 


100 


73 




Post 


00 


00 


00 


77 


59 


83 


94 


12 




Change 


- 4 


0 


0 


65 


-26 


- 8 


- 6 


-61 


3 


Pre 


o4 


00 


06 


08 


63 


96 


88 


81 




Post 


04 


17 


00 


81 


96 


74 


82 


12 




Change 


0 


17 


- 6 


73 


33 


-22 


- 6 


-69 


k 


Pre 


19 


59 


23 


5.0 


74 


21 


53 


23 




Post 


26 


50 


24 


77 


63 


25 


47 


15 




Change 


7 


- 9 


1 


27 


-11 


4 


- 6 


- 8 


5 


Pre 


19 


61 


4l 


81 


4l 


21 


35 


12 




Post 


44 


70 


47 


83 


33 


21 


4l 


4 




Change 


25 


9 


6 


2 


- 8 


0 


6 


- 8 


6 


Pre 


30 


57 


18 


42 


67 


25 


4l 


31 




Post 


4l 


35 


06 


81 


33 


38 


76 


12 




Change 


11 


-22 


-12 


39 


-34 


13 


35 


-19 


7 


Pre 


04 


00 


06 


35 


96 


92 


94 


58 




Post 


04 


09 


12 


77 


93 


79 


82 


23 




Change 


0 


9 


6 


42 


- 3 


-13 


-12 


-35 


8 


Pre 


37 


65 


53 


88 


4l 


21 


24 


00 




Post 


37 


48 


65 


77 


37 


17 


18 


15 




Change 


0 


-17 


12 


-11 


- 4 


- 4 


- 6 


15 


9 


Pre 


52 


75 


71 


96 


22 


08 


12 


00 




Post 


56 


88 


76 


81 


22 


o4 


12 


08 




Change 


4 


13 


5 


-15 


0 


- 4 


0 


8 


10 


Pre 


22 


63 


47 


81 


52 


17 


41 


08 




Post 


19 


59 


4l 


89 


52 


17 


47 


12 




Change 


- 3 


- 4 


- 6 


8 


0 


0 


6 


4 


U 


R*e 


07 


50 


29 


50 


56 


29 


4l 


23 




Post 


26. 


46 


18 


50 


56 


37 


59 


27 




Change 


19 


- 4 


-U 


0 


0 


•8 


18 


4 


12 


Pre 


07 


04 


06 


00 


78 


92 


88 


100 




Post 


04 


00 


-00 


50 


85 


96 


100 


35 




Chsnee 


^ 3 




* 6 


50 


7 


4 


12 


-65 


iotc: 


In the nectiiary ponditon poliams 


a Bdints 


Siam in front of a 


Qbaage 




indlpftes liq^iieiiient, 


since 


a minus sign 


there 


shows 


that fewer on 



the post-test than on the pre-test failed to meet the necessary ccmdition* 



TABLE A-9. Pre- and Post-Teat Mean Difficult Indices for Students to Whom 
Class Beasoning Was Deliberately by Item Chnoups and 

Grades. 



Item 

Group 


Test 


Grade 

N* 


5 

25 


5 

25 


5 

27 


16 

22 


24 


1 


Pre 




76 


91 


95 


96 


99 




Post 




6k 


97 


93 


96 


98 




Change 




-12 


6 


- 2 


0 


- 1 


2 


Pre 




68 


74 


72 


84 


89 




Post 




70 


86 


90 


90 


98 




Change 




2 


12 


18 


6 


9 


3 


Pre 






45 


51 


71 


85 




Post 




38 


56 


72 


84 


92 




Change 




k 


11 


21 


13 


7 


k 


Pre 




k9 


4l 


49 


6l 


77 




Post 




37 


55 


51 


80 


78 




Change 




-12 


l4 


2 


19 


1 


5 


Pre 




65 


69 


78 


80 


88 




Post 




69 


80 


87 


84 


95 




Change 




k 


11 


9 


4 


7 


6 


Pre 




5k 


82 


92 


81 


91 




Post 




6l 


84 


88 


85 


93 




Change 




7 


2 


- 4 


4 


2 


7 


Pre 




36 


41 


4o 


56 


70 




Post 




3^ 


47 


59 


75 


77 




Change 




- 2 


6 


19 


19 


7 


8 


Pre 




39 


42 


54 


64 


83 




Post 




3*^ 


50 


67 


84 


90 




Change 




- 5 


8 


13 


20 


7 


9 


Pre 




k9 


54 


70 


68 


78 




Post 




53 


69 


65 


73 


BS 




Change 




k 


15 


- 5 


5 


8 


10 


Pre 




kl 


56 


61 


59 


63 




Post 




39 


53 


55 


56 


73 




Change 




- 8 


- 3 


- 6 


- 3 


10 


U 


Ere 




U6 


59 


81 


74 


88 




Post 




k3 


65 


83 


78 


85 




Change 




- 3 


6 


2 


4 


- 3 


12 


Pre 




k6 


43 


77 


72 


81 




Post 




58 


70 


79 


83 


94 




Change 




12 


27 


2 


11 


13 






mrnkm 









o 








•ilABLE A-10. Fre- and Fost-Teet Fercentages of Students Who Were Deliberately 
Tau^t Class Reasoning Who Met the 'Sufficient Condition Fbr 
Mastery and Percentages Who Failed to Meet the Necessary Con- 
dition^ by Item Groiq> and Grade 



Item 

Group 


Grade 
Test H= 


k 

2? 


Meeting The 
Sufficient Condition 
6 8 10 12 

25 27 22 2b 


Failing to Meet The 
Necessary Condition 
b 6 8 10 
25 25 27 22 


12 

2b 


1 


Vre 


62 




100 






23 


00 






66“ 




Fost 


50 


100 


89 


96 


96 


39 


00 


00 


00 


00 




Change 


-12 


16 


-11 


0 


- b 


l6 


0 


0 


0 


0 


2 


Ere 


k2 


bb 


70 


82 


8b 


31 


20 


Ob 


05 


Ob 




Fost 


58 


76 


89 


86 


100 


35 


Ob 


Ob 


09 


00 




Change 


16 


32 


19 


b 


16 


b 


-16 


0 


b 


- b 


3 


Ere 


Ob 


l6 


30 


bl 


79 


81 


68 


59 


32 


08 




Post 


Ob 


bb 


56 


77 


8b 


89 


ko 


22 


lb 


Ob 




Change 


0 


28 


26 


36 


5 


8 


00 

CM 

1 


-37 


-18 


- b 


k 


Ere 


12 


16 


15 


32 


59 


62 


80 


63 


b6 


a 




Post 


08 


28 


26 


59 


8b 


65 


i»b 


56 


18 


08 




Change 


- b 


12 


11 


27 


25 


3 


-36 


- 7 


-28 


-13 


5 


Pre 


b6 


36 


63 


73 


88 


31 


20 


Ob 


09 


Ob 




Poet 


b2 


6b 


81 


82 


96 


19 


12 


07 


09 


00 




Change 


- b 


28 


18 


9 


8 


-12 


- 8 


. 3 


0 


- b 


6 


Pre 


27 


76 


93 


77 


88 


5b 


08 


Ob 


09 


Ob 




Post 


39 


72 


93 


86 


88 


k6 


08 


Ob 


05 


Ob 




Change 


12 


- b 


0 


9 


0 


- 8 


0 


0 


- b 


0 


7 


Pre 


00 


16 


22 


23 


50 


89 


80 


63 


55 


36 




Post 


08 


32 


37 


b6 


63 


81 


6b 


52 


27 


12 




Change 


8 


l6 


15 


23 


13 


- 8 


-16 


-11 


-28 


-25 


8 


Pre 


Ob 


08 


26 


36 


71 


77 


60 


56 


bl 


16 




Post 


00 


20 


bb 


68 


79 


89 


60 


30 


lb 


Ob 




Change 


- b 


12 


18 


32 


8 


12 


0 


-26 


-27 


-13 


9 


Fre 


27 


16 


bl 


bl 


50 


59 


56 


19 


32 


a 




Post 


27 


b8 


30 


55 


79 


kS 


36 


30 


23 


13 




Change 


0 


32 


-11 


lb 


29 


-11 


-20 


11 


- 9 


- 8 


10 


Pre 


12 


2b 


37 


32 


33 


59 


52 


37 


55 


b6 




Post 


12 


20 


19 


36 


59 


7b 


6b 


56 


55 


25 




Change 


0 


- b 


-18 


b 


26 


15 


12 


19 


0 


-a 


U 


Pre 


19 


36 


67 


b6 


79 


55 


52 


15 


18 


08 




Post 


15 


36 


7b 


6b 


75 


67 


36 


15 


lb 


17 




Change 


- b 


0 


7 


18 


- b 


12 


-26 


0 


- b 


9 


12 


Rre 


35 


20 


67 


59 


67 


52 


6b 


11 


lb 


06 




Post 


b2 


6b 


78 


73 


88 


ii8 


28 


15 


00 


00 




Change 


7 


bb 


U 


lb 


a 


- b 


-36 


b 


-lb 


- 8 



iofU: In ^e necessary condition coiiaiiai a aiiius sign in Trent of a diante 
indicates i a provem en t^ since a miinis sign there shows that fewer on 
the post-test than on the pre-test failed to meet the necessary condition. 



TAH£ A-U. Conditional Reasoning Weights and Constants for Multiple 
Regression Equations Making Use of Pre-Test. 



Total Corresponding Cons- 





Grade 


CA 


IQ 


SES 


Sex 


Pre-Test 

Score 


Pre-Test 

Score 


tant 


Total 

Score 


7.826 


-.4261 


.1179 


-1.531 


.<•95 


.7480 




18.62 


Coopo- 


















nent 


CP 


2.760 


-. 14 p 4 


.0385 


-.460 


-.652 


-;0584 


.970 


6.86 


sr 


.845 


-.0421 


.0189 


-.174 


.419 


.0803 


-.127 


2.37 


SU 


.899 


-.0372 


.0084 


-.294 


.503 


.0614 


-.120 


2.77 


Item 

<»roup 


1 


.254 


-.0166 


.0155 


-.056 


.173 


.0290 


.011 


1.94 


2 


1.307 


-.0647 


.0035 


-.0914 


-.018 


-.0113 


.614 


1.68 


3 


1.379 


-.0809 


.0062 


-.057 


-.472 


.0003 


.133 


5.15 


k 


- .001 


.0074 


.0064 


-.127 


.423 


.0384 


.314 


- 1.26 


5 


.008 


-.0039 


.0190 


-.082 


-.275 


.0367 


.324 


•39 


6 


.123 


-.0193 


.0163 


-.215 


.747 


.0761 


.005 


3.81 


1 


.648 


-.0215 


-.0142 


.018 


.280 


.0137 


.406 


.51 


8 


.088 


.0093 


.0202 


-.097 


.082 


.0282 


.129 


- .5*10 


9 


- .271 


.0173 


.0224 


-.097 


-.453 


.0192 


.016 


.82 


10 


.177 


-.0018 


.0384 


-.001 


-. 2 ii 9 


•0239 


.305 


- 3.49 


11 


- .322 


.0176 


.0123 


.006 


.638 


.0757 


.ito 


- 3.61 


12 


1.489 


-.0954 


-.0245 


-.254 


-.090 


.0037 


.029 


9.05 
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TABI£ A*12. Conditional Reasoning Weights and Ckmatants for Multiple 
Regression Eqiuations Hot Using Bre-Test Scores. 





Grade 


“ 5 S 


— 15 


m 


Sex 


Constant 


Total 


Score 


.116 


-.5330 


.4074 


-1.332 


.592 


10.33 


Ccnpo- 


nent 

CP 


5-327 


-.2557 


.1770 


- .457 


-.495 


11.21 


ST 


1.216 


-.0531 


.0443 


- .169 


.462 


1.55 


SU 


1.211 


-.0501 


.0280 


- .280 


.483 


2.58 


Item 

Gtoiq) 


1 


.hOZ 


-.0192 


.0305 


-.046 


.211 


1.38 


2 


1.6k0 


-.0905 


.0016 


-.080 


-.489 


5.20 


3 


1.^32 


-.0841 


.0060 


-.059 


-.558 


5.66 


k 


.152 


.0100 


.0362 


-.108 


.464 


-3.30 


5 


.263 


-.0074 


.0147 


-.055 


-.083 


- .76 


6 


.512 


-.0302 


.0134 


-.196 


.757 


2.96 


7 


1.110 


-.0430 


-.0132 


.069 


.126 


1.70 


8 


.113 


-0033 


.0360 


-.085 


.089 


- .96 


9 


-.113 


.0123 


.0347 


-.092 


-.465 


.75 


10 


.361 


.0020 


.0601 


.010 


-.279 


- 4.88 


11 


.056 


.0096 


.0469 


.026 


.728 


-5.07 


12 


1.536 


-.1003 


-.0308 


-.261 


-.017 


10.72 



TABLE A- 13 * Class Beasoning Vfeig^ts and Constants for Itiltlple Itegresslon 
Equations Making Use of Pre-Test. 





(krade CA 


IQ 


SES 


Sex 


Total 

Pre-Test 

Score 


Q^esponding 

Pre-Test 

Score 


Cons- 

tant 


Total 

Score 


-.778 .2014 


.31*67 


.767 


-1.250 


.6209 




- 39-46 


CoDpo- 

nent 
















CP 


-. 0 l »9 .0450 


.1555 


.353 


- .221 


.0885 


tf\ 

• 


-10.06 


SI 


-.678 .0931 


.0230 


-.079 


.237 


.0289 


.154 


- 7.09 


SO 


.160 .0003 


.0501 


.197 


- .154 


.0860 


.104 


— 6.06 


Item 

Group 
















1 


.040 -.0009 


.0212 


.121 


- .007 


.0114 


.668 


- 2.21 


2 


.337 -.0257 


.0254 


.035 


.025 


.0242 


.089 


1.54 


3 


-.112 .0229 


-.0011 


-.052 


- .220 


.0173 


.407 


- .57 


if 


-.394 .0540 


.0053 


-.078 


- .036 


-.0000 


.396 


- 3.58 


5 


-.086 .0124 


.0248 


.002 


.270 


.0095 


.170 


- 1.08 


6 


-.246 .0251 


.0286 


.086 


.275 


.0144 


.350 


- 3-53 


7 


-.045 .0077 


.0236 


-.006 


- .181 


.0304 


.373 


- 3-01 


8 


.057 .0135 


.0104 


.016 


- .084 


—0241 


.430 


- .47 


9 


-.055 -0089 


.0321 


.092 


- .096 


.0286 


-.007 


- 2.73 


10 


-.277 .0329 


.0353 


.107 


- .226 


.0019 


.297 


- 5.31 


11 


-.092 .0124 


.0302 


.079 


- .123 


.0359 


.149 


- 3.71 


12 


.098 -.0051 


.0128 


.095 


- .175 


.0294 


.144 


.77 



o 
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TABLE A-l 4 . Class Beasonlng Wel^ts and Constants for Multiple Regression 
Equations Not Using Pre-Test Scores. 





Grade 


CA 


IQ 


SES 


Sex 


Constant 


Total 

Score 


. 7^1 


.2405 


.6369 


.593 


- 2.221 


- 50 . 5 ^ 


Compo- 

nent 












• 


CF 


.636 


.6191 


.2835 


.310 


-.841 


-12.43 


SY 


-.527 


.0914 


.0423 


-.094 


-.274 


- 7.57 


SU 


•363 


.0095 


.0970 


.172 


-.299 


- 8.17 


Item 

6ro\q;> 














1 


.2 k 6 


-.0107 


.0450 


.103 


-.003 


- 5.78 


2 


.384 


-.0224 


.0396 


.037 


-.006 


.95 


3 


-.057 


.0335 


.0202 


-.062 


-.312 


- 2.60 


k 


-.215 


.0448 


.0074 


-.134 


-.191 


- 1.97 


5 


-i 057 


.0145 


.0316 


.000 


.236 


- 1.04 


6 


-.072 


.0162 


.0483 


.83 


.023 


- 3.53 


7 


.169 


.0049 


. 044 l 


-.016 


-.221 


- 3.56 


8 


.228 


.0147 


.0127 


.011 


-.278 


- 1.47 


9 


.015 


.0106 


.0453 


.084 


-.143 


- 3.24 


10 


-.355 


.0427 


.0436 


.125 


-.341 


- 6.06 


11 


-.013 


.0181 


.0547 


.074 


-.134 


- 5.21 


12 


.200 


-.0041 


.0321 


.082 


-.253 


.15 



o 
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A-1 Plotted Points: Conditional Beasoning Mean 

Difficul’^ I&dex vs. Percentage 
Meeting the Sufficient Condition 





V 



Percent not Meeting Necessary Condition 



V 



(braph Plotted Points: Conditional Beasoning Mean 

Difficulty Index vs* Percentage 
Ptil^ng to Meet the Neceesery 
Condition 




Percent Meeting Sufficient Conditi«i 



Graph A-3* Plotted Points: Class Reasoning Mean Difficulty Index 

vs. Percentage Meeting the SuMcient 
Condition. 
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Qrvjijti A-4. Plotted Points: Class Reasoning Mean RLffieultar 

Index vs. Percentage Veiling to 
Meet the Hecessazy Condition. 
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AFPERIHX B. TH5 COBNEIL IMUCTION TESTS: 

"THE CORNELL CONDITIONAL REASONING TEST, FORM X" 
"THE CORNELL CLASS REASONING TEST, FORM X" 
TRIAL ANSWER SHEET FOR LOWER £££MENTARI STUDENTS 



The foUoving tvo tests, ‘which are described in Chapter IV, are the 
ones 'that were used in this s-tudy. The copies appearing here are 
exactly ‘the same as ‘those 'that were used. 

Each consists of 22 pages with J8 nunbered items, ‘the first six 
of which are sample items. Answers are gi'vren in Chapter IV, Tables IV-1 
and IV-2. 

The trial answer sheet, which was mentioned in Chapter IV, is 
reproduced here in order ‘to show -the direction of our -thinking in 
extending these tests to the lower elementary le-vels* 






3 ^ 



& 



-t~v' . 



: ■'.Wf ^ 



Cornell Criticol Blinking Test Series 

THE CORNELL CONDmONAL-REASORING TEST, FORM X 

by 

Robert H. Ennis 
William L. Gordiner 
John Guzzetta 
Richard Morrow 
Dieter Paulus 
lucille Ringel 



Fill in blanks ^en you are asked to do so; 



Print your lost name only 

Print your first and middle names 

Your age on your last birthday 

Your date of birth: month day 

Your grade 

Your school 

Your regular teacher at this time 
Today’s date: month day 



years 

year 



year 



General directions : 



Do not 
write in 
this space 



^ ^ ® particular kind of thinking. We call it 

already do sone of this kind of 
thinking. Bie saa^le questions make clear lihat is expected. 

K 1^ GU^ WI^. niere is a scoring penalty for guessing wrong. If you 

toi^ you have the answer, but are not sure, mark tiiat answer. But if you have 
no idea, then skip the question. ^ 

ttere are 6 ea^e queationa, then 72 othera. You ahould vork as quickly as you 

^11 ® you do the asBoles, you 

Will be able to move right along. ^ 

DO WOT TURN THE PAGE UNTIL YOUR EXAMDIER «ngT.T.q YOU TO DO SO. 



0 1964 by R. H. amis 

published by ComeU Critical Blinking Project, Stone HbU, Ithaca, 
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In answering each question^ use only What you are told in that question. In order 
to do thie> you should imagine that your mind is blanks because some of the things 
you are told are obviously false. Even so, you should suppose that they are true — 
for that question only. 

You will be given one or ZDore sentences with ^Ich to think. You will then be 
given another sentence, about Which you must decide, using only what you were told. 

Ihere are three possible answers. (Oils is What they mean: 

A. YES It must be true. 

B. NO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enoufi^i to be certain Aether it is "YES" or "HO" . 

Ihe meaning of the possible answers is given at the top of each page to help you 
remember. Each question has only one correct answer. 

Mark your answers on this booklet by drawing a circle around the ri€^t answer. 
Remember: If you have no idea what the answer is, skip the question and go on 

to the next. Do not guess wildly, but if you think you know, then answer the 
question. 



Sample questions: 




Read the first question and see how it is marked. 




1. Suppose you know that 




Bill is next to Sam. 


1. A.(m]) 


Then would this be true? 


B. HO 


Sam is next to Bill. 


C. MAYBE 


The correct answer is A, "YES". If Bill is next to Sam, then San must be next to 
Bill. It must be true, so a circle is drawn around "YES”. 


Here is another sample. This time you circle the answer. 




2. Suppose you know that 




The sparrow is over the hawk. 


2. A. YES 


Ihen would 'Qils be Inrue? 


B. HD 


The hawk is over the sparrow. 


C. MAYBE 



You should have circled B, "HD". If tiie sparrow is over tiie hawk, then the hawk 
^ can't be over the sparrow. It can't be true. 

ERIC 
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Here is a reminder of the meaning of the possible ansvers: 

A. YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You meren't told enough 

certain whether it is ’ICES" or "HO". 




Circle the answer to this next sample. Be careful: 



3* Siqpose you know that 



Jane is standing near Betsy. 


3. A. YES 


Ihen would this be true? 


B. m> 


Betsy is standing near Jane. 


C. MAYBE 



Die correct answer is C, *NAYBE”. Even if Jane is standing near Betay, Betsy might 
be sitti^. Betsy might be sta n d in g near Jane, but she mi^t be sitting near Jane* 

or something else. You were not told enough to be certain about iU^roSttXBE" is 
the answer. 



Circle the answer to this next san^le question. Rened>er that your mind is supposed 
to be blank at the beginning of each question. 



4. Suppose you knov that 



California is near Hew York. 


4. A. YES 


Ttien would this be true? 


B. HO 


Hew York is near California. 


C. MAYBE 



Bie correct answer is A, "YES", even tiioufih York and California are not really 
near to eadi other. If California were near to Hew York, then Uev York would be 
near to California. It would have toTe true. ~ ' " ' ■ ■ 



Remesfccr: You should sappose that what you are told is true — for the ouestlon 
you are answering. 
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Bere is a remiiider of the SManing of the poaalble anavera: 

A. YES It iBuat be true. 

B. BD It can't be true. 

C. MAYBE It may be true or it nay not be true. You ir'**en't told 

enough to be certain whether it is "YEB” or ”HD". 

So far in the aaiq^e questions you were told only one thing. In this one you are 
told tvD things. Circle your answer. 



5 . Suppose you know that 



The pit is Inside ‘ttie mouth of 'Qie fox. 

Ihe cheny is inside the mouth of the fox. 


5* A. YES 


Then would this be true? 


B. MO 


The pit is inside 'tiie (herry. 


C. MAYBE 



Bie correct answer is "MAYBE". All you are told is liiat the pit and the cfaexiy 
are both in the mouth of the fox. Ihere is no way to be certain ihether the pit 
is in ■Qie cherry or not. 



Here is the last sample question. Biis tiae the letters "X" and "Y" are used, 
ihey can stand for anything you like* Circle your answer: 



6. SiQpose you know that 




X is next to Y. 


6. A. YEB 


Then would this be true? 


B. MO 


Y is next to X. 


C. MAYBE 



Bie correct answer is A, ’YES", no matter i«iat X and Y stand for. If X is next 
to Y, then Y must be next to X. 



low that you have done the practice questirais you probably underatand ihat is 
eiqpected. If you have any questions, ask them now. 



BO MOT TUBE THE PA(2 






[• YOU ARB TOLD TO BO SO. 
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Here is a reninder of the meaning of the possible answers: 

A. XES It must be true. 

B. BO It can't be true. 

C. MAXBE It may be true or it may not be true. You weren't told 

enougli to be certain whether it is "US" or "BO”. 



7* Sigppose you know that 



If the hat on the table is blue, then it belongs to Joan« 
Ihe hat on the table is blue. 

Ihen ia>uld this be true? 

Ihe hat on the table belongs to Joan. 




8. Siqppose you know that 

If the car in the parking lot is Mr. SMith's, then 
it is blue. 

fhe car in the parking lot is not blue. 




8. A. YES 


Ttien would this be tunie? 


B. BO 


Obe car in the parking lot is Mr. Shdlh's. 


C. MftZBB 


9. Si:ppo8e you know that 




If Tom lives in the ihite house, then his last ram^ 




is SMith. 

Tom does not live in the white house. 


9* A. YES 


Then mould this be true? 


B. BO 


Tom's last name is not Staith. 


C. MORE 



10. Suppose you know that 

Barry is or the football team only if he has his 
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&re is a r e a tn d e r of the neaning of the possible answers: 

A. XE8 It nust be true. 

B. BO It can't be true. 

C. MAXBB It nay be true or it nay not be true. You weren't told 

enouG^ to be certain whether it is "YES" or "BO”. 



11. Suppose you know that 

If Mary lives in the white house^ tiien her last nasie 
is Brown. 

liBiy's last name is Brown. 

Ihen would this be true? 

Mary lives in the white house. 



11. A. 

B. BO 

C. HAXHB 



12. Suppose you know that 

John is in the kitchen only if there ia food in 
the kitchen. 

Dhere is no food in the kitchen. 

Ihen would this be true? 

John is in the kitchen. 



12. A. 

B. BO 

C. MAXBB 



13* Stqipose you know that 

If the autoabbile in the parking lot beloi^ to Mr. 
Brown, then it ia black. 

Obe autoiDobile in Ihe parking lot doesn't belong 
to Mr. Brown. 

Ihen would this be true? 

Ihe autoabbile isn't black. 

l4. Suppose you know that 



13* A. IBS 

B. BO 

C. 




ERIC 



Cornell Condltional-Bessoning Test> Form X 



Page 7 



Here is a reminder of the meaning of the possible answers: 

A* YES It must be true. 

B. NO It can't be true. 

C. NAYBE It may be true or it may not be true. You weren't told 

enouc^ to be certain whether it is "YES" or "NO". 



15* Suppose you know that 




Ihere is an X only if there is a Y. 
Ihere is not a Y. 


15. A. YES 


Ihen would this be true? 


B. NO 


Ihere is an X. 


C. MAYBE 


l6. Suppose you know that 




Dick was not at home yesterday afternoon. 

If Blck was not at the football game yesterday 
afternoon he was at home. 


16 . A. YES 


Ihen would this be true? 


B. NO 


Blck WBs not at the football game yesterday 
afternoon. 


C. MAYBE 

• 


17* Suppose you know that 




atom may use paints only if he has cleaned iqp his 
clay work, 
atom may use paints. 


17* A. YES 


Olhen would this be true? 


B. NO 


atom has cleaned up his clay work. 


C. MAYBE 


18. Suppose you know that 




Fred, went to a movie last ni^t. 

If Ptoed does not go to a movle^ he feels bad 
the next day. 


18. A. YES 


ahen would this be true? 


B. NO 


Ptoed does not feel bad today. 


C. MAYBE 
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Here is a reminder of the meaning of the possible answers: 

A. YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enough to be certain whether it is "YES" or "HO". 



19* Suppose you know that 

If there is an X, then there is a Y. 
Ihere is an X. 

Ihen would this be true? 

Ihere is a Y. 


19* A. 

B. 

C. 


YES 

NO 

MAYBE 


20. Suppose you know that 

Mary will be in the school ploy only if i^e likes plays. 
Mary will be in the school play. 


20. A. 


YES 


Ihen would this be true? 


B. 


NO 


Mary does not like plays. 


C. 


MAYBE 


21. Siq^se you know that 

Tom is playing ball only if he has a ball glove. 
Tom does not have a ball glove. 


21. A. 


YES 


Then would this be true? 


B. 


NO 


Tom is playing ball. 


C. 


MAYBE 



22. Siq^se you know that 




ERIC 
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Here la a reminder of the meaning of the poaaible ansvera: 

A. YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enouc^ to be certain whether it la "YES" or "MO". 



23. Suppose you know that 




If idiales are birds^ then they can fly. 
Whales aren't birds. 


23. A. YES 


Then would this be true? 


B. HO 


Whales can't fly. 


C. MAYBE 


24. Suppose you know that 




If Bill lives on a farm^ then he has a pet dog. 
Bill has a pet dog. 


24. A. YES 


Ihen would this be true? 


B. NO 


Bill lives on a farm. 


C. MAYBE 


23* Suppose you know that 




Jerry was not asked to ploy boll. 

Jerry is not home only if he was asked to play ball. 


2^. A. YES 


Ihen would this be true? 


B. NO 


Jerry is not home. 


C. MAYBE 



26. Suppoae you know that 

If Mary lives in the green houses then her last name 



is Jones. 

Mary doesn't live in the green house. 


26. A. YES 


Ihen would ‘ttiis be true? 


B. NO 


Mary's last name is not Jones. 


C. MAYBE 
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Here is a reainder of the meaning of the possible answers: 



A. lES It oust be true* 

B. ND It can't be true* 

C* HAYBE It may be true or it may not be true. You weren't told 
enouj^ to be certain whether it is ”YES” or ’HO". 



27* Suppose you know that 

If the coat in the closet is brown, tnen it belongs to 
Sue* 

Bie coat in the closet is brown* 

!Ehen would this be true? 

Die coat in the closet does not belong to Sue* 




27* A. YES 
B* HO 
C* HAYHB 


28. Stgjpose you know that 




Ohere are black cats only if there are pink cate* 




Diere are black cats* 


28. A* YES 


Ihen would this be true? 


B* HO 


There are pink cats* 


C* MAYBE 



29* Stg[^se you knov that 



30* 



If the bicycle in the garage is Bob's, then it is red 
Bie bicycle in the garage' is not red* 

3hen would this be true? 

Dje bicycle in the garage is not Bob's* 



29- A. YES 
B* BO 
C* HAYBE 




Suppose you know that 

If there is an X, then there is a Y. 
Ihere is a Y* 

Ihen would this be true? 

Ihere is an X. 



30* A. YES 
B* BO 
C. MAYEB- 
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Here is a reminder of the meaning of the possible ansvers: 

A. XES It must be true* 

B* IK) It can't be true* 

C. MAIBE It nay be true or it may not be true. You veren't told 
enou^ to be certain whether it is "YES” or "HO"* 



31* Suppose you know that 

If mice have five legs> then they run faster than 
horses. 

Mice do have five legs. 

Ihen would this be true? 

Mice run faster than horses. 


31. A. YES 

B. NO 

C. MAIBE 


32. Suppose you know that 

If Jane fell off her horse^ then £&e hurt herself 
badly. 

Jane hurt herself badly. 


32. A. YES 


Ihen would this be true? 


B. NO 


Jane fell off her horse. 


C. MAIBE 


33* Suppose you know that 

!Ihe short pencil is not Bill's favorite pencil. *• 
Ihe short pencil is not Bill's favorite, only if 
it is dull. 


33* A. YES 


Ihen would this be true? 


B. NO 


Ihe short pencil is dull. 


C* MAIBE 



3^* Suppose you know that 



If there is an X, then there is a Y. 




inhere is not an X. 


3V. A. XS8 


Hhen would this be true? 


B. m 


Ihere is not a Y. 


C. WXBB 



o 

ERIC 
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Here is a reminder of the meaning of the possible ansvers: 

A. YES It mist be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You veren't told 

enouc^ to be certain whether it is or "HO”. 



3^* Suppose you kno^: that 




If John lives in the vhite ho\ise> then his last name 
is Staith. 

John's last name is not Smith. 


3^. A. YES 


"Would this be true? 


B. HO 


John does live in the white house. 


C. MAYBE 


36. Suppose you know that 




Birds can fly only if "they can play "the piano. 
Birds cannot play the piano. 


36. A. YEB 


Ihen would this be true? 


B. HO 


Birds can fly. 


C. MAYBE 


37 > Suppose you know that 




Ihe car will start. 

If the temperature is not below freezing, the 
car will start. 


37* A. IBB 


Ihen would this be true? 


B. BO 


The "temperature is not below freezing. 


C. tUXBE 


38. Siqppose you know that 




Ihere is an X only if there is a Y. 
Ihere is an X. 


33. A. YES 


Ihen would this be true? 


B. HO 


Ihere is a Y. 


C. MAYBE 



o 

ERIC 
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Here is a reminder of the meaning of the possible answers: 

A. YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enough to be certain whether it is "YES" or "NO". 



39* Suppose you Imow* that 



If dogs have four legs, then they have three eyes. 
Dogs don't have three eyes. 


39* A. YES 


Ihen would this be true? 


B. ND 


Dogs do have four legs. 


C. MAYBE 


Suppose you know that 

If Jean goes to the park, she will see her friend Pat. 
Today, Jean is going to the park. 




kO. A. YES 


Then would this be true? 


B. NO 


Today, Jean will see her friend Pat. 


C. MAYBE 


4l. Siqipose you know that 

If horses are green, then they have two tails. 
Horses have two tails. 




4l. A. YES 


Then would this be true? 


B. NO 


Horses are green. 


C. MAYBE 


h2* Suppose you know that 




The red pencils belong to Sally only if they are on 
the table. 

The red pencils are not on the table. 




k2. A. YES 


Then would this be true? 


B. NO 


The red pencils do not belong to Sally. 


C. MAYBE 
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Here is a reminder of the meaning of the possible ansvers: 




A. YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enou^ to be certain whether it is "YES" or "HD" . 


43 . Suppose you know that 




If Faiil rides his bike to school^ he goes the long vsy^ 




Paul rode his bike to school tod^. 

If Paul goes the long way, he gets to school late. 


43 . A. YES 


Then would this be true? 


B. nj 


Paul was not late for school today. 


C. MAYBE 


44. Suppose you knowr that 




If the chair is green, then the table is black. 


44. A. YES 


Then would this be true? 


B. SO 


If the table is black, then the chair is green. 


C. MAYBE 


4^. Suppose you know lhat 




If there is a blue pencil in the second box, then there 
is a green pencil in the first box. 




If there is a green pencil in the first box, then 
there is a red pencil in the third box. 


4^. A. YES 


Then would this be true? 


B. HD 


If there is a blue pencil in the second box, then 
there is a red pencil in the third box. 


C. MAYBE 


46. Suppose you know that 




If Mrs. Smith entered the flower show, then she entered 
her roses. 


46. A. YES 


Then would this be true? 


B. SD 


If Mrs. Smith didn't enter her roses, then she 
didn't enter the flower show. 


C. MAYBE 
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Here is a reminder of the meaning of the possible answers: 




A. YES It must be true. 

B. RO It can*t be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enou^ to be certain idiether it is "YES" or "MO". 


^ 7 * Suppose you know that 




Bill will see Audrey^ if and only if he goes to Montreal. 
Bill will not see Audrey this year. 


>7. A. YES 


Ihen would tbiis be true? 


B. MO 


Bill is going to Montreal this year. 


C. MAYBE 


U 8 . Suppose you know that 




If Gary sees Sharon^ he goes to Canada. 




!Diis winter Gary saw Sharon. 

Gary goes skating only if he goes to Canada. 


A. YES 


Ihen would this be true? 


B. MO 


Ihis winter Gary went skating. 


C. MAYBE 


U9. Suppose you know that 




If there is an A, tiien there is a B. 
If there is a B^ then there is a C. 


U9. A. YES 


3 hen would this be true? 


B. MO 


If there is an A, then there is a C. 


C. MAYBE 


50. Suppose you know that 




If birds can fly^ then they have six legs. 


50. A. YES 


Dien would this be true? 


B. MO 


If birds don't have six legs, then they can't fly. 


C. MAYBE 
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Here ia a reminder of the meaning of Ihe possible answers : 

A. IBS It must be true. 

B. NO It can't be true. 

C. MAIBE It may be true or it may not be true. You weren't told 

enough to be certain whether it is "YES" or "NO" . 



51. Suppose you know that 

If the bus goes to town^ then it passes the old stone 
church. 



The bus goes to town. 



If it passes the old stone diurch, then it goes over 
'Uie new bridge . 

Ihen would this be true? 

The bus doesn't go over the new bridge. 


51« A. YES 

B. NO 

C. NAXBB 


^2. Suppose you know liiat 

If the school team loses this game^ Brighton High will 
win the league pennant. 

If Joe does not hit a homer on this pitch, the school 
team will lose this game. 

Qhen would this be true? 

If Joe does not hit a homer on this pitch, Britton 
High will win the league pennant. 




52. A. YES 

B. NO 

C. MAYBE 


53* Suppose you know that 

If Jean goes shopping, she goes to Chicago. 

Last Saturday Jean went shopping. 

Jean visits her aunt only if she goes to Chicago. 

Then would this be true? 

Last Saturday Jean visited her aunt. 




53- A. YES 

B. NO 

C. MAYBE 


5^. Suppose you know that 

Tom will go skating, if and only if he can borrow 


xraziK's jacKeii. 

Tom is not going skating. 

Then would this be true? 

Tom can borrow Prank's Jacket. 


A. YES 

B. NO 

C. MAYBE 
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Here is s reminder of the meaning of the possible answers: 



A. YES It must be true. 

B. ND It can't be true. 

C. MAYBE It may be true or it may not be true. 'You weren't told 



enou^ to be certain whether it is "YES” or ”H 0 ” 


1 

• 


5 ^* Siq^se you know that 




If Sam misses the bus, he will walk to school. 

If Sam walks to school, he will cross the bridge. 


33 * A. YES 


Then would this be true? 


B. no 


If Sam misses the bus, he will cross the bridge. 


C. MAYBE 


36. Suppose you know that 




If Bob did not bijy a new baseball glove, then 
he played basketball today. 


56. A. YES 


Then would this be true? 


B. no 


If Bob did not play basketball today, then he 
did buy a new baseball glove. 


C. MAYBE 



57 * Suppose you know that 



If Bill has an apple in his lunchbox, then Sally has a 
cracker in her lunchbox. 


57. A. 


YES 


Then would this be true? 


B. 


BO 


If Sally has a cracker in her lunchbox, then Bill 
has an apple in his lunchbox. 


C. 


MAYBE 


38. Suppose you know that 






Betty is going to the movies. 






Betty is not going to the movies, if and only 
if Ann is going to the movies. 


58. A. 


YES 


Then would this be true? 


B. 


no 


Ann is going to the movies. 


c. 


MAYBE 
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Here ia a reminder ot the meaning or the possible answers: 

A. YES It must be true. 

B. RO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

anoufi^ to be certain whether it is "YES" or "MO". 

59 * Siqppose you know that 



If there is an X, then there is a Y. 


99 * A. YES 


Then would this be true? 


B. MO 


If there is a Y^ then there is an X. 


C. MAYBE 


6o. Suppose you know that 




Elephants are pink^ if and only if they are large. 
Elephants are not pink. 


60. A. YES 


Then would this be true? 


B. MO 


Elephants are large. 


C. MAYBE 


6l. Suppose you know that 




If there is an X, then 'Uiere is a Y. 


61. A. YES 


!Ihen would this be true? 


B. MO 


If there is not a Y, then there is not an X. 


C. MAYBE 


62. Siqi^se you know that 




If John has the red chalky then he is making a poster 
for the play. 

John has the red chalk. 

If John is making a poster for the play, then he is 
in the library. 


62. A. YES 


Then would this be true? 


B. MO 


Jc^ is in the library. 


C. MAYBE 



o 

ERIC 

. i* 
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Here is a reminder of the meaning of the possible answers: 

A. YES It must be true. 

B. K) It can*t be true. 

C. MAYBE It nay be true or it may not be true. You weren't told 

enough to be certain lAiether it is "YES" or "NO”. 



63 * Suppose you know that 

Ihat bicycle belongs to John> if and only if it is ared. 

That bicycle does not belong to John. 63 . A. YES 



Then would this be true? 


B. NO 


That bicycle is not red. 


C. MAYBE 


64. Suppose you know that 




If a dog can stand on its front legs^ then it is a 
puppy. 


64. A. YES 


Then would this be true? 


B. NO 


If a dog is a yappy, then it can stand on its 
front legs. 


C. MAYBE 


65 . Siqipose you know that 




If there is an X, then there is a Y. 
There is an X. 

There is a Z only if there is a Y. 


65 . A. YES 


Then would this be true? 


B. NO 


There is a Z. 


C. MAYBE 



66. Siq^se you know that 

If Kate is in Mrs. Jones' class^ then she is out on the 
playground. 



If Kate is out on the playgrtnind, then she is juog>ing 
rope. • 


66. A. XBS 


Then wo\ald this be true? 


B. NO 


If Kate is in Mrs. Jones' class, then she is 
jumping rope. 


C. MAYBE 



o 

ERIC 
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Here is a reminder of the possible ansvers: 




A. YES It must be true. 

B. MO It can't be tame. 





C. MAYBE It may be true or it may not be true. You weren't told 
enouj^i to be certain Aether it is "YES” or "MO". 



67. Suppose you know that 




If there is an then thei^ is a Y. 

Ghere is an X. 

If there is a Y^ then there is a Z. 


67. A. YES 


Ghen vould 'tiiis be true? 


B. MO 


Glhere is not a Z. 


C. MAYBE 


68. Siq^se you knov that 




If Jane did not go to 'ttie movies yesterday^ liien 
i^e sav her fa:lend Pat. 

Jane vent to the park yestearday only if she sav 
her friend Pat. 

Jane did not go to liie movies yesterday. 


68. A. YES 


Ghen vould this be tame? 


B. ND 


Jane vent to the park yestearday. 


C. MAYBE 


69. Suppose you knov l^at 




If Nancy bought a nev dress> then ^e vent to 
tiie shop on Main Street. 


69* A. YES 


Ghen vould this be tame? 


B. MO 


If Nancy didn't go to the shop on Main Street, then 
she didn't buy a nev dress. 


C. MAYBE 


70. Siqpose you knov that 




If John is not in schoo: ^ then he has a cold. 


70. A. YES 


Ghen vould this be tame? 


B. NO 


If John has a cold, then he is not in school. 


C. MAYBE 
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Here is a reminder of the meaning of the possible answers: 

A. YES It must be true. 

B. NO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enough to be certain idiether it is "YES” or "NO". 




71. Suppose you Isnow that 

If Sally is writing a report at home^ then the library is 
closed. 



Sally is writing a report at home. 






2>Lck is using the classroom dictionary only if the 






library is closed. 


71. A. 


YES 


Uhen would this be true? 


B. 


NO 


Dick is using the classroom dictionary. 


C. 


MAYBE 



72. Suppose you know that 

If there are no blue pencils in the first box, then 
there is a green pencil in the second box. 

If 'Uiere is a green pencil in the second box, then 



there is a red pencil in the third box. 
Diere are no blue pencils in the first box. 

Then would this be true? 

There are no red pencils in the third box. 


72. A. YES 

B. NO 

C. MAYBE 


73* Siqipose you know that 

If an animal is a turtle, then it can fly. 
If an animal can fly, then it has feathers. 


73. A. YES 


!Ihen would this be true? 


B. ND 


If an animal is a turtle, then it has feathers. 


C. MAYBE 


7^. Suppose you know that 

If there is a yellow marble in the first box, then 
there is a blue marble in the second box. 




7*^. A. YES 


Then would this be true? 


B. NO 


If there is not a blue marble in the second box. 


C. MAYBE 


then there is not a yellow marble in the first 
box. 
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Here Is a reminder of the meaning of the possible answers: 

A. YES It must be true. 

B. MO It can*t be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enoyg^i to be certain whether it is "YES" or "NO". 



75 • Siqppose you know that 

If people have fins, then they live in water. 



People have fins. 




People can swim only if they live in water. 


75 • A. YES 


Then would this be true? 


B. MO 


People can swim. 


C. MAYBE 



\ 



76» Sitppose you know that 

If “ttiis animal is a dog, then it can fly. 



This animal is a dog. 




If an animal can fly, then it has feathers. 


76 . A. YES 


Then would this be true? 


B. MO 


This animal does not have feathers. 


C. MAYBE 



77« Suppose you know that 



If John is on the volleyball team -then he is good at 
volleyball. 


77 . A. YES 


Then would this be true? 


B. MO 


If John is good at volleyball, then he is on the 


C. MAYBE 


volleyball teem. 



78 . Suppose you know that 



There is a Y, if and only if there is an X. 




There is not a Y. 


78 . A. YES 


Hhen would this be true? 


B. NO 


There is an X. 


C. MAYBE 



END OF TEST* 00 BACK AMD CHECK YOUR AH5HERS. 
o 

ERIC 
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Fill in the blanks uhen you are asked to do so; 



Print your last name only 
Print your first and middle names 

Your age on your last birthday 

Your date of birth: month day 

Your grade 

Your school 

Your regular teacher at this time 
Today »s date: month day 



year 



year 



years 



Do not 
vrite in 
this space: 



General directions : 




Biis is a test to see how well you do a particular kind of thinking. We call 
it class reasoning". You will see that you already do some of this kind of 
thinking. Bie sacple questions make clear idiat is e;]q)ected. 

DO NOT GUESS WIIDLY . Biere is a scoring penalty for guessing wrong. 

If you ‘Qiink you have the answer^ but are not sure^ mark that answer. 

But if you have no idea, then skip the question. 

There are 6 sample questions, then J 2 others. You should work as quickly 
as you can, but do not rush. This is not a speed test. Once you do the 
sanples, you will be able to move right along. 

DO NOT TWRN THE PAGE UNTIL YOUR EXAMINER 'nCTT.g yoU 

TO DO SO 




1964 by R. H. Ennis 

Published by Cornell Critical Thinking Project, Stone Hall, Ithaca, N.Y. 
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Answering the Qaestions ; 

In answering each question, use only ^at you are told in that question. In 
order to do this, you should imagine that your mind is blank, because some of 
the things you are told are obviously false. Even so, you should exqipose that 
they are true— for that question only. 

You will be given one or more sentences with Which to think. You will then be 
given another sentence, about which you must decide, using only what you were 
told. 

Ihere are three possible answers. This is ^at they mean: 

A. YES It must be true. 

B. NO It can*t be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enough to be certain whether it is "YES" or "HO". 

Bie meaning of the possible answers is given at the top of each page to help 
you remember. Each question has only one correct answer. 

Mark your answers on this booklet by drawing a circle around the right answer. 
Remember: If you have no idea what the answer is, skip the question and go on 

to the next. Do not guess wildly, but if you think you know, then answer the 
question. 




Sample questions: 

Read the first question and see how it is marked. 


1. Suppose you know that 




Bill is next to Sam. 


1. A. 


Then would this be true? 


B. NO 


Sam is next to Bill. 


C. MAYBE 


The correct answer is A, "YES". If Bill is next to Sam, then Sam must be next 


to Bill. It must be true, so a circle is drawn around "YES" 


• 


Here is another sample. This time you circle the answer. 




2. Suppose you know that 




The sparrow is over the hawk. 


2. A. YES 


Then would this be true? 


B. HO 


The hawk is over the sparrow. 


C. MAYBE 



You should have circled B, "HO". If the sparrow is over the haMk, then the 
hawk can't be over the sparrow. It can't be true. 
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Here la a reminder of the meaning of the possible answers: 

A. YES It must be true. 

B. HO ' It can't be true. 

C. MAYBE It may be true or it may not be true. You weren’t told 



enough to be certain whether it is "YES" or 


"HO". 






Circle the answer to this next sample. Be careful: 


3* Suppose you know that 








Jane is standing near Betsy. 


3. 


A. 


YES 


Bien would this be true? 




B. 


no 


Betsy is standing near Jane. 




C. 


MAYBE 



Bie correct answer is C, "MAYBE". Even if Tane is standing near Betsy> 

Betsy might be sitting. Betsy mig^t be standing near Jane^ but she mi^^t be 
sitting near Jane, or something else. You were not told enou^^ to be certain 
about it, so "MAYBE" is the answer. 

Circle the answer to this next sample question. Remember 'ttiat your mind is 
stqiposed to be blank at the beginning of each question. 



4 . 



Suppose you know that 

California is near Mw York 
Ihen would this be true? 

Hew York is near California 



k. 



A. 

B. 

C. 



YES 

NO 

MAYBE 



The correct answer is A, "YES", even though Hew York and California are not 
really near to each other. If California were near to Hew York, then Hew York 
would be near to California. It would have to be true. 



Remember: You should siqrpose that lAiat you are told is true — for the 
question you are answering. 
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Here is a reminder of the meaning of the possible answers: 

A. YES It must be true. 

B. NO It can't be true. 

C . MAYBE It may be true or it may not be true . You weren ' c told 

enoufiji to be certain idiether it is "YES" or "NO". 


So far in the saiople questions you were only told one thing. 


In this one you 


are told two things. Circle your answer. 




5* Siqppose you know that 




The pit is inside the mouth of the fox. 




The cherry is inside the mouth of the fox. 


5* A. YES 


Then would this be true? 


B. NO 


The pit is inside the cherry. 


C. MAXBB 



Ohe correct answer is C, "M/ttBE”. All you are told Is that the pit and the 
cherry are both in the mouth of the fox. Biere is no way to be certain Whether 
the pit is in the cherry or not. 



Here is the last eaaple question. Ohis time the letters "X” and are used. 
Ihey can stand for ai^rthing you like* Circle your answer: 



6. Suppose you know that 



X is next to Y. 

Ihen would this be true? 
Y is next to X. 



6 






A. 

B. 

C. 



YES 

MAZBB 



Ihe correct answer is A, "YES", no matter what X and Y stand for. If X is 
next to Y, then Y must be next to X. 



How that you have done tte practice questions you probably understand what is 
ejqpected. If you have any questions, ask them now. 



BO HOT lURR IHE PACaS UNTIL YOU ARB TOU) TO BO SO 



!Die Cornell Class-Reasoning Test^ Ibrm X 



Page 5 



Here 


is a reminder of the meaning of the possible answers. 








A. 

B. 

C. 


YES It must be %rue. 

NO It can*t be tznie. 

MAYBE It may be true or it may not be true. You weren't told 
enough to be certain whether it is "YES” or "NO". 




T- 


Suppose you know that 










All the cars in the garage are Mr. Smith's. 
All Mr. Smith's cars are Eords. 


7 


. A. 


YES 




Ihen would this be true? 




B. 


NO 




All of the cars in the garage are Eords. 




C. 


MAYBE 


8. 


Suppose you know that 










All John's pencils are blue. 


8 


. A. 


YES 




Ihen would this be true? 




B. 


NO 




At least some of Jc^'s pencils are not blue. 




C. 


MAYBE 


9. 


Si:$pose you know that 










All the books about sailing are Bill's. 
All the green books are Bill's. 




9* 


A. YES 




Ihen wo'jld this be true? 






B. NO 




At least some of llie green books are about sailing* 




C. MAXBE 


10. 


Stqipose you know that 










None of Jane's dolls have hats. 


10. A. 


YES 




Ihen would this be true? 




B. 


NO 




None of the dolls *aiat have hats are Janets. 




C. 


miXBE 
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Here is a reminder of the meaning of the possible ansvers# 




A. YB5 It must be true* 

B* HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 
enough to be certain whether it is "YES" or "MO". 


11. Sig^se you know that 




All the red books are John's. 


11. A. YES 


Then irould this be true? 


B. NO 


All John's books are red. 


C. MAYBE 


12. Suppose you know that 




All of 14ary's books are about horses. 

None of the books on the shelf are about horses. 


12. A. YES 


Then would liiis be true? 


B. MD 


At least some of Mary's books are on the shelf. 


C. MAIBE 


13. Sixnpose you know -Uiat 




All Jean's pencils are red. 

All the pencils on the table are red. 


13. A. YES 


Then would this be true? 


B. NO 


At least s<»D6 of the pencils on the table are 
Jean's. 


C. MAYBE 


l4. Siqppose you know that 




At least some of the children in the Martin family 
take out books from the library. 


All people who take out books from the library 
have library cards. 


Ik, A. YES 


Then would this be true? 


B. MO 


At least some of the children in the Martin 
family have library cards. 


C. MAYBE 
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Here is a reminder of the meaning of the possible answers. 

A. YES It must be true. 

B. HO It can't be true. 

C. . MAYBE It may be true or it may not be true. You weren't told 

enou^ to be certain Aether it is "YES" or "NO". 



1^. Suppose you know that 




All X's are Y's. 
No Z's are Y's. 


15. A. YES 


Then would this be true? 


B. NO 


At least scane X's are Z's. 


C. MAYBE 


l6. Suppose you know that 




At least some of Fred's pencils are green. 


16. A. YES 


Then would this be true? 


B. NO 


None of Rred's pencils are green. 


C. MAYBE 


17* Siq^se you know that 




None of Sue's books are about animals. 


17 . A. YES 


Ihen would this be true? 


B. NO 


None of the books about animals are Sue's. 


C. MAYBE 


l8. Suppose you know tiiat 




At least some of Kate's pencils are blue. 
All the pencils in the box are blue. 


18 . A. YES 


Then would this be true? 


B. NO 


At least some of Kate's pencils are in the box. 


C. MAXBB 



er|c 
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Here is a reminder of the meaning of the possible answers • 



A* YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enough to be certain Tdiether it is "YES” or "MO”. 




19* Suppose you Imov that 



All Z's are Y's. 




All Y's are X's. 


19* A. YES 


Ihen would this be true? 


B. NO 


All Z's are X's. 


C. MAYBE 



20. Siq^se you know that 

None of ’Uie fifth grade bpys are an the football 



team. 




John is a fifth grade boy. 


20. A. YES 


Ohen would this be true? 


B. NO 


John is not on the football team. 


C. MAYBE 



21. Suppose you know that 



Boston. 

No one in Ihrank's class has been in Boston. 


21. A. YES 


Ihen would this be true? 


B. NO 


At least some meidsers of the school band 
are in Rwik's class. 


C. MAYBE 


22. Siqppose you know that 




All X's are Y's. 


22. A. ns 


Ohen would this be true? 


B. m> 


At least sosK X's are not Y's. 


c. moat 
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Here 


is a reminder of the meaning of the possible answers* 






A. 

B. 

C. 


YES It must be true* 

NO It can't be true. 

MAYBE It may be true or it may not be true. You weren't told 
enou^ to be certain irtiether it is "YES" or "NO". 




23. 


Siqppose you know that 








All boys are painters* 

All children are painters. 


23 " A. 


YES 




Ihen would this be true? 


B. 


NO 


t 


At least some children are boys. 


C. 


MAYBE 


2 k, 


. Suppose you know that 








All the second grade diildren are out on the 
playground. 


2 k. A. 


YES 




Then would this be true? 


B. 


NO 




All the children out on the playground are 
in the second grade. 


C. 


MAYBE 


25. 


Sig^se you know that 








At least some of ttie books on 'ttie table are 








about stars. 

None of Bob's books are about stars. 


25. A. 


YES 




Ihen would this be tzue? 


B. 


NO 




All of the books on the table are Bob's. j 


l_Jl 


MAIBB 



26. Suppose you know that 




All the boys in John's class are football players* 
IY«d is a football player. 


26. A. YES 


Then would this be true? 


B. NO 


nred is not in John's class. 


C. MAXBE 




The Cornell Class-Beasoning Test> Form X 



Page 10 



Here la a reminder of the meaning of the poaalble anavera. 

A. YES It must be true. 

B. NO It can't be true. 

C. MAYBE It may be true or It may not be true. You weren't told 

enou£^ to be certain Aether It la "YES" or " 1 »". 



27 • Suppose you know that 



All the peta of the Greens' WDn some prize In the 



pet show. 




Fldo la one of the Greens' pets. 


27. A. YES 


Then would this be true? 


B. NO 


Fldo won a prize In the pet show. 


C. MAYBE 



28 . Suppose you know that 



No animals are do^s. 


28. A. YES 


Then would this be true? 


B. NO 


No dogs are animals. 


C. MAY^ 



29 * Suppose you know that 



Eileen is one of the children on the plsQTground* 
Then would this be true? 

Eileen is not one of the children on the 
playground. 


29. A. YES 

B. HO 

C. MAYBE 


30. Suppose you know that 




All X's are Y's. 


30. A. YES 


Then would this be true? 


B. NO 


All Y's are X's. 


C. MAYBE 



o 

ERIC 
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Here is a reminder of the meaning of the possible answers* 




A. YES It must be true. 

B. NO It can’t be true. 

C. MAYBE It may be true or it may not be true. 

enoimh to be certain Aether it is ’ 


You weren’t told 
•yes" or "NO". 


31. Suppose you know that 






All cats can fly. 

Al?; animals that can fly are black. 

/ 




31. A. YES 


/ 

Ihen would this be true? 




B. NO 


All cats are black. 




C. MAYBE 


32. Suppose you know that 






All the things in the trunk are Bill’s. 
The brown baseball bat is Bill’s. 




32. A. YES 


Bien would this be true? 




3 . NO 


0 

The brown baseball bat is in the trunk. 




C. MAYBE 


33. Suppose you know that 






None of Bob’s books ere on the table, but there 
are books on the table. 


33. A. YES 


Then would this be true. 




B. NO 


At least some of the books on the table 
not Bob's. 


are 


C. MAYBE 


3 ^. Suppose you know that 






All X’s are Y’s. 
All Z's are Y’s. 




34. A. YES 


Then would this be true? 




B. NO 


At least some Z’s are X’s. 




C. MAYBE 
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Here is a reminder of the meaning of the possible answers* 

A. YES It must be true. 

B. NO It can*t be true. ^ i;i 

C. MAYBE It may be true or it may not be true. ^ 

enourfi to be certain idiether it is ^CES or NO . 


35. Suppose you know that - 

All Mary's pencils are yellow. 


35. A. YES 


Then wo\ald this be true? 


B. NO 


At least some of Mary's pencils are not yellow. 


C. MAYBE 


36. Suppose you know that 

All pencils are heavy. 

Nothing made of wood is heavy. 


36. A. YES 


Then would this be true? 


B. HO 


• 

At least some pencils are made of wood. 


C. MAYBE 


37. Suppose you know that 

At least some of the green pencils are Dick's. 


37. A. YES 


Then would this be true? 


B. NO 


All Dick's pencils are green. 


C. MAYBE 


38. Suppose you know that 
Ho X's are Y's. 


38. A. YES 


Then would this be true? 


B. NO 


No Y's are X's. 


C. MAYBE 
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Here is a reminder of the meaning of the possible ansvers. 




A. YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enou^ to be certain whether it is "YES" or "MO". 


39* Suppose you know that 




All dogs are brown. 


39* A. YES 


Ihen would Ihis be true? 


B. MD 


At least some dogs are not brown. 


C. MAYBE 


to. Suisse you know that 




All the cookies Jane made for the fair had nuts 




in them. 

All tile cookies with nuts in them were sold. 


to. A. YES 


Then would this be true. 


B. MC 


• 

All the cookies Jane made for the fair were 
sold. 

* 


C. MAYTE 


4l. Suppose you know that 




All brown animals have four legs. 


to. A. YES 


!Ehen would this be true? 


B. MO 


All animals witii four l^s are brown. 


C. MAYBE 


to. Siq^se you know that 




All members of the football team weie^ over 




1^ pounds. 

Henry does not wai^ over 1^0 pounds. 


its. A. XES 


Ihen would this be true? 


B. BO 


Henzy is on the football team. 


C. IKZBB 
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Here is a reminder of the meaning of the possible answers. 




A. YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enou^ to be certain Whether it is "YES" or "HO". 


43. Suppose you know that 




All of John's candy is in the box. 




All of the candy that is not chocolate is also 
not in the box. 


43. A. YES 


!Ehen would this be true? 


B. HO 


At least some of John's candy is not chocolate. , 


C. MAYBE 


44. Sigipose you know that 




All the papers in the box are tom. 
Hone of John's papers are in the box. 


44. A. YES 


Qhen would this be true? 


B. HO 


Hone of John's papers are tom. 


C. MAYBE 


4^. Siq^se you know that 




All of the boys are singing. 


4^. A. YES 


Ihen would this be tme? 


B. HO 


All of the people who are not singing are 
also not boys. 


C. MAYBE 


46. Suppose you know that 




All the math hooiework is due today. 
Hone of Joan's homework is due today. 




All the homework for Mr. Miller's class is 
math homework. 


46. A. YES 


Ihen would this be tme? 


B. IV 


Bone of Joan's homework is for Mr. Miller's 
class. 


C. MAYBE 



o 

ERIC 



ae Cornell Class-Reasoning Tfest, Form X 



Page 15 




Here is a reminder of the meaning of the possible answers . 



A* YES It must be true* 

B. NO It can't be true* 

C* MAYBE It may be true or it may not be true. You weren't told 
enough to be certain whether it is "YES” or "NO"* 



Siqppose you know that 

All the pencils in the box are green. 

All Sue's pencils are sharp. 

All the green pencils are Sue's. 

aen would this be true? 

At least some of liie pencils in the box are 
not sharp. 




A. YES 

B. NO 

C. MAYBE 


Suppose you know that 

None of my shirts are wool. 

Bone of the shirts hanging up in the closet 
are wool. 

aen WDidd this be true? 

At least some of my shirts are hanging up 
in the closet. 




kQ. A. YES 

B. NO 

C. MAYBE 


49. Sigppose you know that 




All X's are Y's. 


A. YES 


aen would this be true? 


B. NO 


All things that are not Y's are also not X's# 


C. MAYBE 




50* Si^pose you know that 



All four-legged animals can fly. 



No horses can fly. 

All fast runners are four-legged animals# 


50. A# YES 


aen would this be true? 


B# K> 


No horses are fast runners# 


C# MAYBE 
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Here is a reminder of the meaning of the possible answers. 

A. YES It must be true. 

B. HO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enouj^ to be certain whether it is "YES" or "IK)". 



^1. Suppose you know that 



All of the boys in the class collect stamps. 



All students tAio are not mefl&>ers of the Stamp 
Club also do not collect stamps. 


A. YES 


Then would this be true? 


B. HD 


At least some of the boys in the class are not 
mexnbers of the Stasp Club. 


C. MAYBE 



^2. Si^ipose you know tiiat 



All of the boys are running, but not everyone 






is running. 


32. A. 


YES 


Then would this be true? 


B. 


IK) 


At least some of the people not running are 


C. 


MAYBE 


not boys. 





53* Siqpose you know that 



Hone of Tom's books are on the idielf. 




Ho science books are on the Shelf. 


53* A. YES 


Then would 'Uiis be true? 


B. K) 


At least some of Tom's books are science books. 


C. MAYBE 



Suppose you know that 



All of Bill's five uncles are allowed to drive. 
All i>eople idio have a license have passed a 
driving test. 



All people who are allowed to drive have a 






license. 


3^. A. 


YES 


Then would this be inrue? 


B. 


BD 


At least one of Bill's uncles has not passed a 


C. 


MAYBE 


driving test. 
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Here is a reminder of the meaning of the possible answers. 

A. YES It must be true. 

B. 1X> It can't be true. 

C. MAXBE It may be true or it may not be true. You weren't told 

enoufi^i to be certain Aether it is "YES” or "MO”. 



35* Suppose you knov that 



All of the band members are working. 

!Dien would this be true? 

Everyone lAio is not working is also not in the 
band. 



36 . Suppose you knov that 

All the books on the cOielf belong to the librazy. 
Mo science books belong to the librazy. 



At least some of the books that ELaer likes 
are on the shelf. 


36 . A. YES 


Ihen would this be true? 


B. MD 


At least some of the books that Elmer likes 
are not science fiction. 


C. MAXBE 


37* Siippose you knov that 




All the people who live on Main Street were bom 
in MlUtown. 




Mone of tie students in Boom 332 live on 
Main Street. 


37 . A. YES 


" Ihen would this be true? 


B. MO 


Mone of the students in Boom 332 were bom 
in Mllltown. 


C. MAYBE 



38 . Siqppose you knov that 



At least some of Mr. Jones' students ride the bus to school. 
All students who live on Boute 33 own dogs. 



All students who ride the bus to school live 
on Boute 33* 


A. ns 


Ihen mould this be true? 


B. ID 


Mone of Mr. Jcmes* students own dogs. 


C. WtXB 



33* A, YES 

B. MO 

C. MAYBE 
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Here is a re min d e r of the meaning of the possible answers: 



A. XES It oust be true. 

B. NO It can't be true. 

C. MAYBE It may be true or it may not be true. You weren't told 

enoufi^x to be certain lihether it is "YES" or "NO". 




59» Suppose you know that 



All Y's are X's. 




No Z's are Y's. 


A. YES 


Sien would this be true? 


B. NO 


No Z's are X's. 


C. MAYBE 



60 . Suppose you know that 



All teachers are college graduates. 



All pec^le irtio have gone to hif^ Bcbool are men« 
All college graduates have gone to hi^ school. 


60 . A. YES 


ihen would this be true? 


B. NO 


At least 8<nne teadiers are not men. 


C. MAYBE 



6l. Sigipose you know that 



All Z's arc Y'c. 



No X's are Y's. 




All T's are Z's. 


A. YES 


Then would this be true? 


B. NO 


No X's are T's. 


C. MAYBE 



62 . Suppose you know that 



All Btudents liio do not have a star are •i so 



not awbners. 




Rrancea is a swinaer. 


6 s. A. IB 


Then would this be true? 


B. BO 


Frances does not have a star. 


C. NUn 
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Here is a remiDder of the aeaning of the posalble ansvera. 



A. YSS It nuBt be true. 

B. BD It can't be true. 

C. NAXBB It nay be true or it nay not be true. You weren't told 



enoufi^ to be certain whether it ia "YES" or 


"BO". 


63. Suippoae you know that 




All the people in the auditorim are watching a novie. 
All atudenta in the aenior play are in the 


ttttdXuOirXUlla 

Bather ia a student in the aenior play. 


63* A. YBB 


Ihen would this be true? 


B. BD 


Bather ia not watching a laovie. 


C. NftXBB 



6 U. Su;ppoBe you know that 



All birds have three eyes. 




Bo ducks are birds. 


61 |. A. YBB 


Then would this be true? 


B. BD 


Bo ducks have three eyes. 


C. MIYBB 



69. Sivpose you know that 



Bo Z'a are Y'a. 




Bo Z'a are Y'a. 


A. ns 


Yhen would thia be true? 


B. » 


At leaat aoae Z'a are Z'a. 


c. wni 



66. SuipoM you know that 



All of the rad pencils are teoken. 




■kLl'a pencil ia not broken. 


66. A. YBB 


Yhen would thia be tmat 


B. BD 


IkUL'a pencil ia not red. 


c. im 
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Here is a resdnder of the meaning of the posalhle anavers* 




A. XES It must he true. 

B. HD It can't he true. 

C. MAXBB It any he true or it any not he true. You veren't told 

enou^t to he certain lAiether it la "YE8” or **H0”. 


67* Sugppose you knov that 




All Z's are Y's. 

All things that are not X's are also not Y's. 


67 . A. YES 


Then would this he true? 


B. HD 


At least some Z's are not X's. 


C. MMCBB 


68. Siqqpose you knov that 




At least some of Mrs. Brovn's flowers ore not roses. 


At least sone of the flowers in the flower show 
are not roses. 


68. A. YES 


Ihen would this he true? 


B. HD 


At least soaie of Mrs. Brown's flowers 
are in the flower khov. 


C. WUEEE 


69* Siq^pose you know that 




All the pencils in the hex are yellov. 




Hone of the broken pencils are yellov. 
All Dick's pencils are in the hex. 


69 . A. YES 


Shen would this he true? 


B. HD 


Hone of Hie broken pencils are Dick's. 


C. MMEBB 


7D. SiQpose you knov that 




All the peo^ Who live near the lake can awln. 




Hone of the students in Nr. Snith's class live 
near the lake. 


TO. A. YES 


9hen would this he true? 


B. HD 


At least warn of the students in Nr. Smith's 
class cannot swim. 


C. IMZBB 
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Here is a reminder of the meaning of the poasihle anaaera. 



A. YES It must he true. 

B. NO It can't he true. 

C. NAIBE It may he true or it may not he true. You weren't told 



enoufi^ to he certain Vhether it is "YES” or 


"NO". 


71. Suppose you knov that 




None of the houses on Main Street are made 




of hrlck. 




Allan's house is not made of hrlck. 


71- A. YES 


Then mouid this he true? 


B. NO 


Allan's house is on Main Street. 


C. MAYBE 



72. Suppose you knov that 



At least some of the hoys in the class have 
bicycles. 



All those vho are not here also do not have 
hlcycles. 


72. A. 


YES 


Then would this he true? 


B. 


NO 


No hoys in the class are here. 


C. 


MAYBE 


73* Suppose you knov that 




All dogs are red. 


73. A. 


YES 


Then would this he true? 


B. 


NO 


All animals that are not red are also not dogs. 


C. 


MAYBE 


74. Si^pose you knov that 






All Nr. Smith's cars have polished huq^s. 


# 




The red car does not have a polished huaper. 
All the cars in the garage are Nr. Smith's. 


74. A. 


YES 


Then would this he true? 


B. 


NO 


The red car is not in the garage. 


C. 


MEYBB 
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Here is a reminder of the meaning of the possible ansvers. 

A. YES It must be true. 

Bi NO It can't be true. 

C. MAYBE It may be true or it may not be true. You veren't told 
enough to be certain Aether it is "YES" or "BO". 



73 . Suppose you know that 




No ducks are birds. 

Bbthing with large feathers is a bird. 


75* A. YES 


Then uould this be true? 


B. BO 


At least some ducks have large feathers. 


C. MAYBE 






76 . Suppose you knov that 




All alligators are smart animals. 

All animals that cannot sing are also not 
smart. 


76. A. YES 


Then uould this be true? 


B. BO 


At least some alligators cannot sing. 


C. MAYBE 


77* Suppose you knov that 




All the students ^0 live in the country have 
pets. 

Barbara does not live in the country. 


77 . A. YES 


Then vould this be true? 


B. BO 


Barbara does not have a pet. 


C. MAYBE 


78 . Suppose you knov that 




All X's are Y's. 
All Z's are T's. 
All Y's are Z's. 


78. A. YES 


Then vould this be true? 


B. BO 


At least some X's are not T's. 


C. MAYBE 



END OF TEST. GO BACK ABD CBKK YOUR ASSHER8 



Trial Anewer Sheet for Lower Elementary Students 
name: - - - 





YES 




NO 




MAYBE 




SKIP 






YES 




ND 




MAYBE 




SKIP 






YES . 




NO 




MAYBE 




SKIP 



CT 

U 





YES 




NO 




MAYBE 




SKIP 






YES 




NO 


• 


MAYBE 




SKIP 






YK 




NO 




MAYBE 




SKIP 




YES 






1 . 

SKIP 






YES 




NO 








SKIP 





YES 




NO 




MAYBE 




SKIP 
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APPENDIX C. SAMPI^S OP TEACHING MATERIAIS. 



Because of space limitations, it is possible to give only a small 
sample of the materials that were used in instruction. Ihe following 
exercises indicate the level of instruction at the beginning and end of 
the instructional periods in upper secondary school, and also indicate 
the level of instruction which was attained in upper elementary. 

These exercises also show the use of the Euler circle system, 
the use of symbols to represent classes and sentences, and the introduction 
of some technical vocabulary. Heavy reliance was placed upon the use 
of such exercises as these. 



Class Reasoning Exercises Used in 10th and 12th Grades, 

Consisting of Three Used Early in the Instructional 

Period and One Used at the End C-1 

Conditional Reasoning Exercises Used in 11th Grade, Consisting 
of Three Used Early in the Instructional Period and 
One Used at the Ehd C-8 

A Class Reasoning Exercise Used toward the End of the Instructional 

Period in ifth and 6th Grades C-15 

A Conditional Reasoning Exercise Used toward the End of the 

Instructional Period in 5th Grade C-l? 



Class Reasoning Exercises Used in 10th and 12th Grades^ Consisting of 

Three Used Early in the Instructional Period and One Used at the £hd. 

Name 

Exercise 1 . 

1. Define "set" 



2. Listed belov are five groups of three objects each. Nhat "set" does 
each group belong to? 

a. my pencil, your pencil, the teacher's pencil - 

b. a cocker spaniel, a terrier, a bloodhound - 

c. bredd, milk, meat - . 

d. books, classes, filmstrips - , 

e. basketball, baseball, vrestling - 

3» List five "sets" of things you encounter every day: 

a • 

b. 

c. ^ 

d. 

e. 

4. Redefine "set" - in your own words and without looking back. 



5» Define "element" 



6* Listed belov are five "sets". For each one, name three elements that 
belong to the set: 

a. books - ___ 

b. dogs - 

o 
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ExerclBe Ij continued 



c. nations - , j 

d. siibJectB taken in school - , , 

e. days of the week - , , 

7* List five objects in this room lAiich are elements of sets: 

» 

&• 

b. 

d. 

e. 

8. Redefine "element" - in your ovn words and without looking back. 




Name 



Eadi of the foUoving pairs of vords includes one set and one element 
of that set. In the space to the ri^^t of each pair draw a circle to 
represent the set^ an x to represent the element^ and label both. 

I have done the first one for you so that you will understand ihat 
is to be done. 



1. sthjects in school 
American History 

2. teachers 
Nr • Monov 




subjects 

American 



in school 
History 



3. Nondsy 

days of the week 



U. newscasters 
Chet Huntley 



this trout 
fish 

6. logicians 

Leonhard Euler 



7. you 

students of logic 

8. birds 



warm-blooded animals 



Egerclac 3 » 



KBne 
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1* Define "total Inclusion" 



2. Belov are ei^t pairs of sets. Determine the relatlon^ip between 

them, and draw circle diagrams to represent that relation^ip. 

Diagrams 

a. universities 
state universities 

b. things to write with 

pens 

c. American nations 
BOrth American nations 

d. suBBer months 
months 

e. suits 
clothing 

f • things vbidi entertain 
movies 

g. states of the Ihiited States 
southern states of the Itoited States 

h. presidential candidates 
Bepdhlican presidential candidates 

3* Bedafiae the relatioBrtiip of total inclusion, using your am words and 
without looJting back 



Quiz 



Name 

Judge each of the foUovlog arguments. Decide itdiether the conclusion 
must foHov • If It must^ circle thir vork "VAUD”. If the conclusion 
either can't foUov or may or not follow^ circle the word "INVALID". 

1 . At least some voters favor Wallace. 

All those Who favor Wallace oppose President Johnson. 

Therefore, at least some voters oppose President Johnson. 

Valid Invalid 

2. At least some doge are carnivorous animals. 

Therefore, at least some carnivorous animals are doge. 

Valid Invalid 

3 . At least some ducks are not vlld. 

All vlld animals are protected hy lav. 

Therefore, no ducks are protected by lav. 

Valid Invalid 

k* At least some Bepubllcans do not siipport Rockefeller. 

All the Cayuga County stqpervlsors are Repbulicans. 

Therefore, at least some Cayuga County supervisors do not support 
Rockefeller. 

Valid Invalid 

At least some Assei:d>lymen are not in favor of higher taacii. 

No one iho approves civil rl^^ts Is In favor of high^i^ taxes. 
Therefore, some Assemblymen approve civil ri^ts. 

Valid Invalid 

6. At least some patrolmen use radar. 

All the men in this room use radar. 

Therefore, at least some of the men in this room are patfolmen. 



Valid Invalid 



c-6 



7* At least aone Finns oppose Coanmlsm. 

H6 Marxists oppose Cossninlsm. 

Iherefore^ no Finns are Marxists. 

Valid Invalid 

8. At least some doctors are not surgeons. 

All brain specialists are surgeons* 

!Eherefore> at least some doctors are not brain specialists. 

Valid Invalid 

9 . At least some motorcycles are mot six-cylindered. 

Therefore^ at least some six-cylindered things are not motorcycles. 
Valid Invalid 

10. At least some cameras are expensive. 

At least some Japanese products are not es^nsive. 

Therefore^ at least some cameras are not Japanese products* 

Valid Invalid 

11. At least some Cubans are not ComDunist. 

At least some siqpporters of DeGaulle are not Comnunist. 

Therefore, at least some supporters of DeGaulle are Ctd>ans. 

Valid Invalid 

12. At least some Picasso paintings are valuable. 

All valuable things are expensive. 

!Qierefore> at least some Picasso paintings are expensive. 

Valid Invalid 

13* At least some magazines carry world news. 

At least some daily publications carry world news. 

Therefore, at least some magazines are daily pdblications. 

o 
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Ik* At flOM Qexwn are in Berlin* 

At leaat aone pro-Heatemera are not in Berlin* 
IberefOre^ no OenMn aeientiata are pro-Weatemera. 
Valid Invalid 

13* At leaat aoae eancera can be ctored* 

Bottling that can be cured is a texninal case* 

Therefore^ at least sone cancers are not tezminal cases* 
Valid Invalid 




Conditional Beaaoning Exercises Used in lltfa Grade, Consisting of 

Ihree Used Early in the Instructional Period and One Used at the End. 

'Exercise 1' 

Find, label and put in parentheses the antecedents and consequents 
in each of the following: 

1. If a dog is a beagle, then he can hunt rabbits. 

2* If zoBd}ies sing, there is moonli^t. 

3 * Ihere are phlips if there are phlops. 

4. Parking pemits are legal if they are issued by the police chief. 

3. If it requires real thouc^t, homework is good. 

6 . If you should fail all your English tests, then you will definitely 
fail the course. 

7. If conns are klobbered, klobs are conned. 

t. I will go to the World's Fair if I can get a hotel reservation in New 
York. 

9 . That team of wrestlers must be good if they can beat the Ithaca team. 
Cows recite poetry if the Queen of Hearts plays scrabble. 



10 . 



C-9 

'Exercise 2' 

Try making each of the following arguments valid by aff inning the 



antecedent and concluding the consequent* 



1. Premise 
Premise 
Conclusion 

2. Premise 
Premise 
Conclusion 

3* Premise 
Premise 
Conclusion 

k. VreaA.Be 

VrealBC 

Conclusion 

Premise 

Premise 

Conclusion 

6. Premise 
itemise 
Conclusion 

7. Premise 
Premise 
Conclusion 

8* Premise 
Premise 
Conclusion 



- If (Joe makes that free throw), (we wlU win the game). 

-( ) 

- therefore, ( ) 

- If (there is a circle), then (there is a square) 

- ( ) 

- Thierefore, ( ) 

- ( These are valuable bocks) if (they are hand-printed) 

. ( ) 

- Therefore, ( ) 

- If (this specimen is an insect), then (it has three pairs 

of legs) 

- ( ) 

- Therefore, ( ) 

- (I will be late for school) if (l eat six eggs) 

- ( ) 

- Therefore, ( ) 

- If (John is a Junior), (he is in Mr. Brown's hoseroott) 

- ( ) 

- Therefore, ( ) 

- (The argument is valid) if (l affirm the antecedent) 

- ( ) 

- Therefore, ( ) 

- If (a whonbit is a sabit), (d pringle is a plop) 

. ( ) 

- Therefore, ( ) 



o 
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9* Frenlfle 



(l viU be unhappy) if (l don't vln the contest) 



Rremlse 



) 



Conclusion 



There tore, ( 



) 



o 
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'Exercise 3' 



Study each of these arguments, and indicate whether it is valid 
invalid hy circling the appropriate word. 



1. If it is Saturday, then you can sleep late. 

It is Saturday. 

Dierefore, you can sleep late. 

2. If you pass all your tests, you will pass the course. 
You have passed all yo\ir tests. 

Therefore, you have passed the course. 

3* If Mike is a dog, then he is an animal. 

Mike is an animal. 

Therefore, Mike is a dog. 

k. You must pay a fine if your library book is overdue. 
Your library book is overdue. 

Therefore, you must pay a fine 
5« If a car runs out of gas, it will stall. 

Hsr car has stalled. 

Therefore, my car has run out of gas. 

6. Lemonade is bitter if there is no sugar in it. 

There is no sugar in this lemonade. 

Therefore, this lemonade is bitter. 

7. If we win the slalom, then we'll hove a gold medal. 

Ve will win the slalom. 

Therefore, we won't have a gold medal. 

8. If p, q. 

P« 

Therefore, q. 



Valid 



Valid 



Valid 



Valid 



Valid 



Valid 



Valid 



Valid 



Invalid 



Invalid 



Invalid 



Invalid 



Invalid 



Invalid 



Invalid 



Invalid 
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9* q if p 

q 

Therefore, p. Valid 

10. We'll have a hootenanny if ve can get the Rooftop Singers. 

We can get the Rooftop singers. . 

Therefore, ve'U have a hootenanny. Valid 




Invalid 



Invalid 
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'Exercise l4' 

Name 

Is the underlined conclusion valid?: 

If a questionnaire Is distributed to all adult members of a coomunlty^ 

If this qaestlonnelre asks whether the person thinks slave labor urong^ 

If there is at least 90# response, and if everyone tells the truth - then, 
the conmunlty really thinks slave labor is vrong. If at least 80# say they 
think slave labor is wrong. A questionnaire was distributed to all adult 
menbers of Smith town , and it asked whether they thought slave labor was 
wrong. 95# of them responded to the questionnaire, and the people of 
Staithtown always tell the truth. 

Bkjw I know that Smith town really thinks slave labor is right. Therefore, 
it is false that at least 80# of the adults of Smithtown said that they 

t 

think slave labor is wrong . 

P 

q 

r 

s 

t 



u 

Steps 

1 . 

2 . 

3. 

k. 




% 

6 . 

7 . 

8 . 

9 . 



Reasons : 



Reasons 



10 . 

11 . 

12 . 

etc. 



o 
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A Class Beason^ Exercise Used toward the Ehd of the Instructlonsl 
Fariod in 4th and 6th (h*ades 

Grad e 

nam e 

Dat e 

Directions: Read the arguments carefully. Bien using the Euler circle, 
diagram them. Circle the correct answer for each question. 
Remember, work against the conclusion hut without 
breaking the rules. Good Blinking: 



All Parisians are Frenchmen. 


a) Valid 


All IVenchmen are Europeans. 


b) Invalid 


All Parisians are Europeans. 




Jb doge are cows. 


a) Valid 


Bo cows are dogs. 


b) Invalid 


All Frenchmen are Europeans. 


a) Valid 


All Parisians are Frenchmen. 


b) Invalid 


All Europeans are people. 




All Parisians are people. 




All trout ore fish. 


a) Valid 


All rainbows are trout. 


b) Invalid 


No cats are fish. 




Bo cots are Rainbows. 




All Parisians are Frenchmen. 


a) Valid 


Bo Ithacans are Parisians 


b) Invalid 


Bo Ithacans are Frendunen. 





ERIC 



C-15 



C-l6 



6 . Mb A ’8 are B's. a) Valid 

Mb B *8 are C*s . b) Invalid 

Mb A '8 are C'a. 

7. All lione are cats. a) Valid 

All tigers are cats . b) Invalid 

All lions are tigers. 

8 . All nice have tails. a) Valid 

All rats have tails . b) Invalid 

Mb mice are rats. 

9. All A*s are B’s. a) Valid 

Mb C’s are A’s . b) Invalid 

Mo B's are C's. 

10 . All potatois «re vegetables. a) Valid 

Mo Anericans are ytaeUSblcB. b) Invalid 

Mo -Jberlcans are potatos 




A Conditional Reasoning Ekerciee Used toward the fiid of the 
Instructional Period in 5th Grade 

Wan e 

Date 

Grad e 

Directions: Using the method of writing the symbols ri^^t over the 
sentences^ decide whether each of the following arguments is valid or 
invalid, \frite valid or invalid in the space provided^ whichever is 
correct. On the line below each argument^ write vbat should be in the 
conclusion. 

1» - If this is an apple, then it grows on a tree. 

This is an apple. 

Therefore, it grows on a tree. 



2. If this is a Buick, then it is an automobile. 

It is not an automobile. 

Therefore, it is a Buick. 



_ If you like ice cream, then you will eat it often. 
You do eat ice cream often. 

Therefore, you like ice cream. 



If this is a book, then it has pages. 
This is iK>t a book. 

Therefore, it does not have pages. 





If this is an inclined plane, then it is not a lever. 
It is a lever. 

Therefore, it is not an inclined plane. 



If zebras have stripes^ then so do tigers. 
Zebras do not have stripes. 

Therefore^ nothing follows^ necessarily. 



It has a fulcrum^ if it is a lever. 
It is a lever. 

Iherefore^ it has a fulcrum. 



!Ehe man has a hamner^ if he is a carpenter. 
The man has a hammer. 

Therefore^ he is a carpenter. 



Elephants fly^ only if birds have trunks. 
Elephants do fly. 

Iherefore^ birds have trunks. 



If it rains toni£^t, ve will catch a fish tomorrow. 
If we catch a fish tomorrow, then we will eat it. 
It rains toni^^t. 
therefore, we will eat it. 



If we passed our grade, then ve passed our subjects. 
If we passed our sii^Jects, then ve studied. 

We did not study. 

Therefore, we passed our grade. 
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12« If vheee ocxxm, then gooosh hraaack. 

Wheee oooom. 

Therefore^ goooah hraaack* 



13* Either you like sunny days or you like rainy days. 

You like sunny days. 

Therefore, you like rainy days. 



l4. If this Is a seat, then you sit In It. 

This Is not a seat. 

Therefore, you do not sit In it. 



13 . If girls grow beards, then, boys wear lipstick. 

Boys do not wear lipstick. 

Therefore, nothing follows, necessarily. 



16 . I f then $. 

Nbt 

therefore, not 



17« I f you are old enou^^, you nay stay up until P. 1 I. 

You Bay stay up until 9:00 P.M. only If you b^ave. 
You are old enou£(h. 

Therefore, you behave. 




This l8 a simple machine^ If it la a pulley, 
this la not a simple machine. 

Iherefore^ nothing follows necessarily. 



Sally's dress either has a belt or it is red. 
Sally's dress does not have a belt. 
!Eherefore^ it Is red. 



If hee^ then ha. 
Ha. 

therefore > hee. 



If this is a screv, then it has threads. 

It does not have threads. 

therefore ^ nothing follows^ necessarily. 



If Jane likes Betty^ then she sent Betty a valentine. 
Jane likes Betty. 

therefore, she sent Betty a valentine. 



If this has a fulcrum, tnen It is a lever. 

It is a lever only if It is a simple machine 
It Is not a single machine. 

Therefore, It does not have a fulcrum. 



If boo. 



'Uien bee. 



Bee. 



Therefore, nothing follows, necessarily. 
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2$« __ T his is 8 vedge only if It is not a pulley. 
It is a vedge. 

(Therefore^ nothing follows necessarily. 




ERSOBS 



Page and Line No» 

II- 22, 1.21: H. P. Grice 

III- 3, 1.17: Change ’directly’ to ’deliberately’. 

III-3, 1.22: Quotes around "1113)1-2 ’s" 

III- 8 & 9: Table No. III-2 instead of III-3 

IV- 10, 1.7: xanless 

IV-15: Replace line 3 and last two vords of line 2 with the following: 

"...application of the concept vhen the operation has not been 
performed, in particular \dien other operations have been performed'. 

IV-27, 1.13: Cnit comma after ’see’. 

IV- 28: Note #6 should read: "The correlations for CA for grades ccabined 

are based upon a random sanqple of IDT’s. For conditional 
reasoning N=64; for class reasoning, N*82. 

V- 2, Piaget quote, 1.1: between 

V-9, 1.19: Insert a comma after ’question’ 

V- 12, 1.1: "...that arguments with suggestive content..." 

VI- 11, 1.9: Cronbach’s 

VI-2U, end of line 25: Add ’be’. 



VI-28, L17: 



inconsistent 



